Natural orifice translumenal endoscopic surgery is an emerging procedure. High fidelity virtual reality-based simulators allow development of new surgical procedures and tools and train medical personnel without risk to human patients. As part of a project funded by the National Institutes of Health, we are developing a Virtual Transluminal Endoscopic Surgery Trainer (VTEST^TM) for this purpose. In this work, objective performance measures derived from motion tracking sensors attached to an endoscope was tested for the transgastric NOTES appendectomy procedure performed with ex-vivo pig organs using the EASIE-R^TM trainer box. Results from our study shows that both completion time and economy of motion parameters were able to differentiate between expert and novice NOTES surgeons with p value of 0.039 and 0.02 respectively. Jerk computed on sensor 2 data also showed significant results (p = 0.02). We plan to incorporate these objective performance measures in VTEST^TM.