The University of Colorado's Center for Human Simulation has developed fundamental algorithms for real-time visual and haptic interaction with polygonal and voxel based data sets, including those derived from the Visible Human Dataset™ These algorithms are currently being used to create prototype simulators for surgery, needle insertion (anesthesiology, radiology, and rheumatology), dentistry, and ophthalmology. This paper briefly discusses our segmentation and classification effort as well as our ability to create texturemapped polygonal models directly from the data: both are fundamental to the creation of anatomically based simulators.