Ultrasound image-guided interventions are widespread in surgery because of the non-invasive character of the procedures. However, hand/eye synchronization is relatively difficult for a surgeon. Ultrasound image-based visual servoing is one way to perform this kind of surgery. In this work, the control of instrument motion based on ultrasound images through nonlinear model predictive control is investigated. This new scheme ensures the convergence of the instrument to the desired position and also offers the possibility of satisfying constraints such as joint limits, actuator saturation and visibility preserving. This paper describes the proposed controller. The efficiency and the robustness of the proposed solution to control a six degree-of-freedom mechanical system is first illustrated by simulation. Experiments on a Mitsubishi PA10 robot highlight the efficiency of the vision control scheme to handle constraints of ultrasound image-based visual servoing.
Abolmaesumi, P., Salcudean, S., Zhu, W., Sirouspour, M., and DiMaio, S. (2001). Imageguided control of a robot for medical ultrasound . IEEE Transactions on Robotics and Automation, 18(1): 11—23.
2.
Allgöwer, F., Badgwell, T.A., Qin, S.J., Rawlings, J.B., and Wright, S.J. (1999). Nonlinear predictive control and moving horizon estimation — an introductory overwiew. In Advances in Control: Highlights of ECC'99, pp. 391—449.
3.
Batcha, W. and Krupa, A. (2006). Towards ultrasound image-based visual servoing . In Proceedings of IEEE International Conference on Robotics and Automation (ICRA'06), pp. 4112—4117.
4.
Chavanon, O., Carrat, L., Pasqualini, C., Dubois, E., Blin, D., and Troccaz, J. (2000). Computer-guided pericardiocentesis: experimental results and clinical perspectives. Herz,25(8): 761—768.
5.
Diegeler, A., Hirsch, R., Schneider, F., Schilling, L., Falk, V., Rauch, T., and Mohr, F. (2000). Neuromonitoring and neurocognitive outcome in off-pump versus conventional coronary bypass operation. Annals ofThoracic Surgery, 69: 1162—1166.
6.
Downing, S.D., Herzog, W.A., McLaughlin, J.S., and Gilbert, T.P. (2002). Beating-heart mitral valve surgery: preliminary model and methodology. Journal of Thoracic and CardiovascularSurgery, 123(6): 1141—1146.
7.
Hastenteufel, M., Yang, S., Christoph, C., Vetter, M., Meinzer, H.-P., and Wolf, I. (2006). Image-based guidance for minimally invasive surgical fibrillation ablation. International Journal of Medical Robotics and Computer AssistedSurgery, 2: 60—69.
8.
Hong, J., Dohi, T., Hashizume, M., Konishi, K., and Hata, N. (2004). An ultrasound-driven needle insertion robot for percutaneous cholecystostomy. Physics in Medicine andBiology , 49(3): 441—455.
9.
Hutchinson, S., Hager, G.D., and Corke, P. (1996). A tutorial on visual servo control. IEEE Transactions on Robotics and Automation, 12(5): 651—670.
10.
Lawrence, G., Zhou, J.L., and Tits, A.L. (1997). User's guide for CFSQP (Version 2.5).
11.
Megali, G., Tonet, O., Stefanini, C., Boccadoro, M., Papaspyropoulos, V., Angelini, L., and Dario, P. (2001). A computer-assisted robotic ultrasound-guided biopsy system for videoassisted surgery. In Proceedings of Medical Imaging Computing and Computer-Assisted Intervention (MICCAI'01) .
12.
Phee, L., Xiao, D., Yuen, J., Chan, C.F., Ho, H., Thng, C.H., Cheng, C., and Ng, W.S. (2005). Ultrasound guided robotic system for transperineal biopsy of the prostate. In Proceedings of IEEE International Conference on Robotics and Automation (ICRA'05), pp. 1327—1332.
13.
Picone, A.L., Lutz, C.J., Finck, C., Carney, D., Gatto, L.A., Paskanik, A., Searles, B., Snyder, K., and Nieman, G. (1999). Multiple sequential insults cause post-pump syndrome. Annals ofThoracic Surgery, 67: 978— 985.
14.
Rastan, A.J., Bittner, H.B., Gummert, J.F., Walther, T., Schewick, C.V., Girdauskas, E., and Mohr, F.W. (2005). On-pump beating heart versus off-pump coronary artery bypass surgery — evidence of pump-induced myocardial injury. European Journal of Cardio-Thoracic Surgery, 27: 1057—1064.
15.
Richalet, J. (1993). Pratique de la commande prédictive, Chapter 4 , pp. 193—199. Hermès.
16.
Sauvée, M., Poignet, P., and Dombre, E. (2006). Towards nonlinear model predictive control for image based visual servoing. In Proceedings of IFAC Workshop on Nonlinear Model Predictive Control for Fast System (NMPCFS'06) , pp. 147—152.
17.
Schneider, O., Troccaz, J., Chavanon, O., and Blin, D. (2000). PADyC: a synergistic robot for cardiac puncturing . In Proceedings of IEEE International Conference on Robotics and Automation (ICRA'00), Volume 3, San Fransisco, USA, pp. 2883—2888.
18.
Stoll, J., Novotny, P., Howe, R., and Dupont, P. (2006). Real-time 3d ultrasound-based servoing of a surgical instrument. In Proc. IEEE Int. Conf. on Robotics and Automation (ICRA'06), pp. 613—618.
19.
Vitrani, M.-A., Morel, G., and Ortmaier, T. (2005). Automatic guidance of a surgical instrument with ultrasound based visual servoing. In Proceedings of IEEE International Conference on Robotics and Automation (ICRA'05), pp. 508— 513.
20.
Wan, I.Y.P., Arifi, A.A., Wan, S., Yip, J.H.Y., Sihoe, A.D.L., Thung, K.H., Wong, E.M.C., and Yim, A.P.C. (2004). Beating heart revascularization with or without cardiopulmonary bypass: evaluation of inflammatory response in a prospective randomiezd study. Journal of Thoracic and CardiovascularSurgery, 127(6): 1624—1631.
