This paper reports the development of a robotic system designed to extend a human’s ability to perform small-scale (sub-millimeter) manipulation tasks requiring human judgment, sensory integration, and hand-eye coordination. Our novel approach, which we call steady-hand micromanipulation, is for tools to be held simultaneously both by the operator’s hand and a specially designed actively controlled robot arm. The robot’s controller senses forces exerted by the operator on the tool and by the tool on the environment, and uses this information in various control modes to provide smooth, tremor-free, precise positional control and force scaling. Our goal is to develop a manipulation system with the precision and sensitivity of a machine, but with the manipulative transparency and immediacy of hand-held tools for tasks characterized by compliant or semi-rigid contacts with the environment.
References
1.
Bargar, W., etal. 1995 (Baltimore, MD). Robodoc Multicenter trial: An interim report . Proc. of the 2nd Intl. Symp. on Medical Robot. and Comp.-Assisted Surgery, MRCAS ’95. Pittsburgh, PA: C/O Center for Orthop. Res., Shadyside Hospital.
2.
Bishoff, J. T., et al. 1998. RCM-PAKY: Clinical application of a new robotic system for precise needle placement . J. Endourology12: S82-S82 .
3.
Cadeddu, J. A., et al. 1998. A robotic system for percutaneous renal access incorporating a remote center of motion design . J. Endourology12: S237-S237 .
4.
Charles, S. 1994. Dexterity enhancement for surgery . Proc. of the First Intl. Symp. on Medical Robot. and Comp.-Assisted Surgery, vol. 2, pp. 145–160 .
5.
Cho, Y., Kotoku, T., and Tanie, K. 1995 (Pittsburgh, PA). Discrete-event-planning and control of telerobotic part mating process with communication delay in geometric uncertainty . Proc. of the IEEE Conf. on Intell. Robot. and Sys. Washington, DC: IEEE Press.
6.
Dinsmoor, C., and Hagermann, P. 1993 (Detroit, MI). Fanuc robotics system r-j controller . Proc. of the Intl. Robots and Vision Automat. Conf.
7.
Eldridge, B., et al. 1996. A remote center of motion robotic arm for computer assisted surgery . Robotica14(1): 103–109 .
8.
Funda, J., et al. 1993 (Boston, MA). Optimal motion control for teleoperated surgical robots . SPIE Intl. Symp. on Optical Tools for Manuf. and Advanced Automat. Bellingham, WA: SPIE.
9.
Funda, J., et al. 1994. Image-guided command and control of a surgical robot . Proc. Med. Meets Virtual Reality II.. San Diego, CA.
10.
Funda, J., et al. 1994. An experimental user interface for an interactive surgical robot . 1st Intl. Symp. on Medical Robot. and Comp.-Assisted Surgery. Pittsburgh, PA.
11.
Funda, J., et al. 1994 (Boston, October). Comparison of two manipulator designs for laparoscopic surgery . SPIE Intl. Symp. on Optical Tools for Manuf. and Advanced Automat. Bellingham, WA: SPIE.
12.
Goradia, T. M., Taylor, R. H., and Auer, L. M. 1997. Robot-assisted minimally invasive neurosurgical procedures: First experimental experience. Proc. of the First Joint Conf. of CVRMed and MRCAS. Grenoble, France: Springer .
13.
Green, P., et al. 1992. Telepresence: Advanced teleoperator technology for minimally invasive surgery (abstract) . Surgical Endoscopy6(91).
14.
Guerrouad, A., and Vidal, P. 1989. SMOS: Stereotaxical microtelemanipulator for ocular surgery. Proc. of the Annual Intl. Conf. of the IEEE Eng. in Med. and Biol. Soc. Los Alamitos, CA: IEEE , vol. 11, pp. 879–880.
15.
Guo, C., Tarn, T. J., and Bejczy, A. 1995 (Nagoya, Japan). Fusion of human and machine intelligence for telerobotic systems . Proc. of the IEEE Conf. on Robot. and Automat. Washington, DC: IEEE.
16.
Harris, S. J., et al. 1997. Experiences with robotic systems for knee surgery. Proc. of the First Joint Conf. of CVRMed and MRCAS. Grenoble, France: Springer .
17.
Ho, S. C., Hibberd, R. D., and Davies, B. L. 1995. Robot-assisted knee surgery. IEEE Eng. Med. Biol. Mag. (special issue on robotics in surgery): 292–300.
18.
Humayun, M. U., et al. 1997. Quantitative measurement of the effects of caffeine and propranolol on surgeon hand tremor . Arch. Opthomol.115: 371–374 .
19.
Hunter, I. W., et al. 1995. Ophthalmic microsurgical robot and associated virtual environment . Comp. Biol. Med.25(2): 173–182 .
20.
Jensen, P. S., et al. 1997. Toward robot-assisted vascular microsurgery in the retina . Graefes Arch. Clin. Exp. Ophthalmol.235(11): 696–701 .
21.
Jensen, P. S., and J. de Juan, E. 1999 (in review). In-vivo microscopy using gradient index of refraction (GRIN) lens endoscopy.
22.
Kazerooni, H. 1989a. Human/robot interaction via the transfer of power and information signals—part I: Dynamics and control analysis. Proc. of the IEEE Conf. on Robot. and Automat. Los Alamitos, CA: IEEE .
23.
Kazerooni, H. 1989b. Human/robot interaction via the transfer of power and information signals—part II: Dynamics and control analysis. Proc. of the IEEE Conf. on Robot. and Automat. Los Alamitos, CA: IEEE .
24.
Kazerooni, H., and Jenhwa, G. 1993. Human extenders . Trans. ASME: J. Dyn. Sys. Meas. Control115(2B): 218–290 .
25.
Kontarinis, D. A., and Howe, R. D. 1995. Tactile display of vibratory information in teleoperation and virtual environments . Presence4(4): 387–402 .
26.
Krotkov, E., and Simmons, R. 1992 (Nice, France). Performance of a six-legged planetary rover: Power, positioning, and autonomous walking . Proc. of the IEEE Intl. Conf. on Robot. and Automat. Washington, DC: IEEE.
27.
Kumar, R., et al. 1997 (Tokyo, Japan). Robot-assisted microneurosurgical procedures, comparative dexterity experiments . Proc. of the Society for Minimally Invasive Therapy, 9th Annual Meeting, abstract book vol. 6, suppl. 1.
28.
Kumar, R., et al. 1999. Performance of robotic augmentation in microsurgery-scale motions . 2nd Intl. Symp. on Medical Image Computing and Comp.-Assisted Surgery. Cambridge, UK.
29.
Kumar, R., Jensen, P., and Taylor, R. H. 1999. Experiments with a steady hand robot in constrained compliant motion and path following . 8th IEEE International Workshop on Robot and Human Interaction (RO-MAN). Pisa, Italy.
30.
Mindell, D. A., et al. 1993. JasonTalk: A standard ROV vehicle control system. Proc. of IEEE/MTS OCEANS’93. Los Alamitos, CA: IEEE .
31.
Misuishi, M., et al. 1997. Dexterity enhancement for a tele-micro-surgery system with multiple macro-micro colocated operation point manipulators and understanding of the operator’s intention. Proc. of the First Joint Conf. on Comp. Vision, Virtual Reality, and Robot. in Med. and Medical Robot. and Comp.-Assisted Surgery. Grenoble, France: Springer .
32.
Mittelstadt, B. D., et al. 1994. The evolution of a surgical robot from prototype to human clinical trial . Proc. of the Intl. Symp. on Medical Robot. and Comp.-Assisted Surgery. Pittsburgh, PA.
33.
Morikawa, H., and Takanashi, N. 1996 (Minneapolis, MN). Ground experiment system for space robots based on predictive bilateral control . Proc. of the IEEE Conf. on Robot. and Automat. Washington, DC: IEEE.
34.
Pournaras, C. J., et al. 1991. New ocular micromanipulator for measurements of retinal and vitreous physiologic parameters in the mammalian eye . Exp. Eye Res.52: 723–727 .
35.
Riviere, C. N., and Khosla, P. K. 1997 (Albuquerque, NM). Augmenting the human-machine interface: Improving manual accuracy . Proc. of the IEEE Conf. on Robot. and Automat. Washington, DC: IEEE.
36.
Riviere, C. N., and Khosla, P. K. 1999a. Intraoperative tremor monitoring for vitreoretinal microsurgery . Proc. of the 2nd Intl. Conf. on Medical Image Computing and Comp.Assisted Interventions (MICCAI 99). Cambridge, UK.
37.
Riviere, C. N., and Khosla, P. K. 1999b. Microscale measurement of surgical instrument motion . Proc. of the 2nd Intl. Conf. on Medical Image Computing and Comp.-Assisted Interventions (MICCAI 99). Cambridge, UK.
38.
Riviere, C. N., and Thakor, N. V. 1996. Modeling and canceling tremor in human-machine interfaces . IEEE Eng. Med. Biol. Mag. (May/June): 29–36 .
39.
Sakakibara, S. 1996 (Taipei, Taiwan). A two-armed intelligent robot assembles mini robots automatically . Proc. of the 1996 IEEE IECON 22nd Intl. Conf. on Industrial Electronics, Control and Instrumentation. Washington, DC: IEEE.
40.
Salcudean, S. E., Ku, S., and Bell, G. 1997. Performance measurement in scaled teleoperation for microsurgery. Proc. of the First Joint Conf. on Comp. Vision, Virtual Reality, and Robot. in Med. and Medical Robot. and Comp.-Assisted Surgery. Grenoble, France: Springer .
41.
Satava, R. 1992. Robotics, telepresence, and virtual reality: A critical analysis for the future of surgery . Minimally Invasive Therapy1: 357–363 .
42.
Schenker, P. S., Das, H. O., and Timothy, R. 1995 (Boston, MA). Development of a new high-dexterity manipulator for robot-assisted microsurgery . Proc. of SPIE—Intl. Soc. for Optical Eng.: Telemanipulator and Telepresence Tech. Bellingham, WA: SPIE.
43.
Sheridan, T. B. 1995. Teleoperation, telerobotics, and telepresence: A progress report . Control Eng. Practice3(2): 205–214 .
44.
Stoianovici, D., et al. 1998. A modular surgical robotic system for image-guided percutaneous procedures. Intl. Conf. on Medical Image Computing and Comp.–Assisted Intervention. New York/Berlin: Springer .
45.
Stoianovici, D., etal. 1997. An efficient needle-injection technique and radiological guidance method for percutaneous procedures. Proc. of the First Joint Conf. of CVRMed II and MRCAS III. Grenoble, France: Springer .
46.
Stoianovici, D., et al. 1998. A modular surgical robotic system for image-guided percutaneous procedures. Medical Image Computing and Comp.-Assisted Interventions (MICCAI-98). 1998. Cambridge, MA: Springer .
47.
Suzuki, H., and Arimoto, S. 1988. Visual control of autonomous mobile robot based on self-organizing model for pattern learning . J. Robot. Sys.5(5): 453–470 .
48.
Taylor, R. H., et al. 1994. An image-directed robotic system for precise orthopaedic surgery . IEEE Trans. Robot. Automat.10(3): 261–275 .
49.
Taylor, R. H., et al. 1995. A telerobotic assistant for laparo-scopic surgery. IEEE Eng. Med. Biol. Mag. (special issue on robotics in surgery): 279–291.
50.
Taylor, R. H., et al. 1996. A telerobotic assistant for laparo-scopic surgery. In Computer-Integrated Surgery, ed. R. H. Taylor et al. Cambridge, MA: MIT Press , pp. 581–592.
51.
Troccaz, J., Peshkin, M., and Davies, B. L. 1997. The use of localizers, robots, and synergistic devices in CAS. Proc. of the First Joint Conf. of CVRMed and MRCAS. Grenoble, France: Springer .
52.
Whitcomb, L. L., Rizzi, A., and Koditschek, D. E. 1993. Comparative experiments with a new adaptive controller for robot arms . IEEE Trans. Robot. Automat.9(1): 59–70 .
53.
Whitcomb, L. L., et al. 1997. Adaptive model-based hybrid control of geometrically constrained robot arms . IEEE Trans. Robot. Automat.13(1): 105–116 .
54.
Xu, Y., and Kanade, T. 1993. Space Robotics: Dynamics and Control. Boston, MA: Kluwer .
55.
Yamamoto, Y., Eda, H., and Yun, X. 1996 (Minneapolis, MN). Coordinated task execution of a human and a mobile manipulator . Proc. of the IEEE Conf. on Robot. and Automat. Washington, DC: IEEE.
56.
Yoerger, D. R., Bradley, A. M., and Walden, B. B. 1992. Autonomous benthic explorer deep ocean scientific auv for seafloor exploration: Untethered on station one year without support ship. Sea Tech. 50–54.
