By understanding surgeons’ patterns of gaze, and what visual information is being obtained during a procedure, one can improve the operation via new techniques or instrumentation. Part of a larger project on Remote Manipulation in Endoscopic Surgery, we analyzed eye patterns of surgeons from videotape annotation. Three categories of eye patterns were defined: 1) eyes on (gaze on monitor); 2) eyes down (gaze on external operative space); 3) eyes off (gaze away from monitor/hands). In the context of hierarchical decomposition of procedures we compared eye patterns and sequential dependencies (gaze as a function of previous gaze) by procedure, surgical steps and tasks. Timelines showed transitions in eye patterns during the procedure. We determined what visual information is available and what visual information is needed by the surgeons. By comparing these, we suggest technology that can provide these needs.