Reconstruction method with twisting measurement and compensation for shape sensing of flexible robots

doi:10.1007/s40436-023-00469-7

Abstract

Abstract: Flexible robots can reach a target treatment part with a complex shape and zigzagging path in a limited space owing to the advantages of a highly flexible structure and high accuracy. Thus, research of the shape detection of flexible robots is important. A reconstruction method including torsion compensation is proposed, then the method with a numerical method that does not include torsion compensation is compared. The microsegment arc between two adjacent measurement points is regarded as an arc in a close plane and a circular helix in three-dimensional (3D) space during the shape reconstruction process. The simulation results show that the two algorithms perform equally well regarding 2D curves. For the 3D curves, the Frenet-based reconstruction method with torsion compensation produced a higher fitting accuracy compared with the numerical method. For the microsegment arc lengths of 40 mm and 20 mm, the maximum relative errors were reduced by 11.3% and 20.1%, respectively, for the 3D curves when the reconstruction method based on Frenet with twisting compensation was used. The lengths of the packaging grid points were 40 mm and 20 mm, and the sensing length was 260 mm for the no-substrate sensor. In addition, a shape reconstruction experiment was performed, and the shape reconstruction accuracies of the sensors were 2.817% and 1.982%.

The full text can be downloaded at https://doi.org/10.1007/s40436-023-00469-7

Key words: Flexible robots, Reconstruction method, Twisting compensation, Frenet-Serret, Shape reconstruction

Xiang-Yan Chen, Ting-Ting Shen, Jin-Wu Qian, Ying-Jie Yu, Zhong-Hua Miao. Reconstruction method with twisting measurement and compensation for shape sensing of flexible robots[J]. Advances in Manufacturing, 2025, 13(4): 886-900.

TrendMD

References

[1] Burgner-Kahrs J, Rucker DC, Choset H (2015) Continuum robots for medical applications: a survey. IEEE Trans Rob 31(6):1261-1280
[2] Gilbert HB, Rucker DC, Webster RJ (2016) Concentric tube robots: the state of the art and future directions. Robot Res 114:253-269
[3] Bergeles C, Yang CZ (2013) From passive tool holders to microsurgeons: safer, smaller, smarter surgical robots. IEEE Trans Biomed Eng 61(5):1565-1576
[4] Berg NJV, Gerwen DGV, Dankelman J et al (2014) Design choices in needle steering—a review. IEEE/ASME Trans Mechatron 20(5):2172-2183
[5] Presti DL, Massaroni C, Leit?o CSJ et al (2020) Fiber bragg gratings for medical applications and future challenges: a review. IEEE Access 8:156863-156888
[6] Yeung BMP, Chiu WY (2016) Application of robotics in gastrointestinal endoscopy: a review. World J Gastroenterol 22(5):1811-1825
[7] Nisha P, Carlo S, Yang GZ et al (2014) Flexible platforms for natural orifice transluminal and endoluminal surgery. Endosc Int Open 2:117-123
[8] Shi C, Luo X, Qi P et al (2016) Shape sensing techniques for continuum robots in minimally invasive surgery: a survey. IEEE Trans Biomed Eng 64(8):1665-1678
[9] Rone WS, Ben-Tzvi P (2014) Continuum robot dynamics utilizing the principle of virtual power. IEEE Trans Rob 30(1):275-287
[10] Chirikjian GS (2015) Conformational modeling of continuum structures in robotics and structural biology: a review. Adv Robot 29(13):817-829
[11] Xie SP, Ni FL, Wanget HR et al (2015) An overview of research on configuration detection of continuum robots. Mech Electron 8:68-71
[12] Croom JM, Rucker DC, Romano JM et al (2010) Visual sensing of continuum robot shape using self-organizing maps. In: IEEE international conference on robotics and automation, 3-8 May, Anchorage, Alaska, pp 4591-4596
[13] Song S, Li Z, Yu H et al (2015) Electromagnetic positioning for tip tracking and shape sensing of flexible robots. IEEE Sens J 15(8):4565-4575
[14] Song S, Zhang C, Liu L et al (2018) Preliminary study on magnetic tracking-based planar shape sensing and navigation for flexible surgical robots in transoral surgery: methods and phantom experiments. Int J Comput Assist Radiol Surg 13(2):241-251
[15] Ryu SC, Dupont PE (2014) Dupont FBG-based shape sensing tubes for continuum robots. In: IEEE international conference on robotics and automation (ICRA), 31 May-7 June, Hong Kong, China, pp 3531-3537
[16] Qi F, Chen B, She SG et al (2020) Shape sensing and feedback control of the catheter robot for interventional surgery. Indus Robot Int J Robot Res Appl 48(2):259-269
[17] Zhang LW, Qian JW, Shen LY et al (2004) FBG sensor devices for spatial shape detection of intelligent colonoscope. In: IEEE international conference on robotics and automation, 26 April-1 May, New Orleans, USA, pp 834-840
[18] Zhang LW, Qian JW, Zhang YN et al (2006) Novel FBG sensor net system for real-time shape detection of intelligent endoscope. Chin J Mech Eng 3(2):177-182
[19] Park YL, Elayaperumal S, Daniel B et al (2010) Real-time estimation of 3-D needle shape and deflection for MRI-guided interventions. IEEE/ASME Trans Mechatron 15(6):906-915
[20] Henken K, Gerwen DV, Dankelman J et al (2012) Accuracy of needle position measurements using fiber bragg gratings. Minim Invasive Ther Allied Technol 21(6):408-414
[21] Shahriar S, Hegeman R, Alambeigi F et al (2019) FBG-based position estimation of highly deformable continuum manipulators: model-dependent vs. data-driven approaches. In: 2019 International symposium on medical robotics (ISMR), 3-5 April, Atlanta, USA. https://doi.org/10.1109/ismr.2019.8710179
[22] Roesthuis RJ, Kemp M, Dobbelsteen VD et al (2013) Three-dimensional needle shape reconstruction using an array of fiber bragg grating sensors. IEEE/ASME Trans Mechatron 19(4):1115-1126
[23] Abayazid M, Kemp M, Misra M et al (2013) 3D flexible needle steering in soft-tissue phantoms using fiber bragg grating sensors. In: IEEE international conference on robotics and automation, 6-10 May, Karlsruhe, Germany, pp 5843-5849
[24] Roesthuis RJ, Misra S (2016) Steering of multisegment continuum manipulators using rigid-link modeling and FBG-based shape sensing. IEEE Trans Rob 32(2):372-382
[25] Xu R, Yurkewich A, Patel RV (2016) Curvature, torsion and force sensing in continuum robots using helically wrapped FBG sensors. IEEE Robot and Autom Lett 1(2):1052-1059
[26] Wei J, Wang S, Li J et al (2017) Novel integrated helical design of single optic fiber for shape sensing of flexible robot. IEEE Sens J 17(20):6627-6636
[27] Khan F, Denasi A, Barrera D et al (2019) Multi-core optical fibers with bragg gratings as shape sensor for flexible medical instruments. IEEE Sens J 19(14):5878-5884
[28] J?ckle S, Eixmann T, Schulz-Hildebrandt T et al (2019) Fiber optical shape sensing of flexible instruments for endovascular navigation. Int J Comput Assist Radiol Surg 14(12):2137-2145
[29] Khan F, Barrera D, Sales S et al (2021) Curvature, twist and pose measurements using fiber bragg gratings in multi-core fiber: a comparative study between helical and straight core fibers. Sens Actuators A 317:112442. https://doi.org/10.1016/j.sna.2020.112442
[30] Zhao SY, Cui JW, Chen MM (2020) Review on optical fibers shape sensing technology. Opt Precision Eng 28(1):10-29
[31] Yang DY, Wu JQ, Qian JW (2003) A research on the 3D reconstruction of the shape of the Endoscope. J Appl Sci 5(4):406-410
[32] Moore JP (2015) Shape sensing using multicore fiber. In: Optical fiber communications conference and exhibition (OFC), Los Angeles, 22-26 March, pp 1-3
[33] Moore JP, Rogge MD (2012) Shape sensing using multi-core fiber optic cable and parametric curve solutions. Opt Express 20(3):2967-2973
[34] Cui J, Zhao S, Yang C et al (2017) Parallel transport frame for fiber shape sensing. IEEE Photonics J 10(1):1-12
[35] Lim S, Han S (2017) Helical extension method for solving the natural equation of a space curve. Surf Topogr Metrol Prop 5(3):035002. https://doi.org/10.1088/2051-672X/aa7ea8
[36] Lim S, Han S (2018) Shape estimation of a bent and twisted cylinder using strain from a sensor array in triple helices. Meas Sci Technol 29(9):095003. https://doi.org/10.1088/1361-6501/aacfb6
[37] Floris I, Madrigal J, Sales S (2021) Twisting measurement and compensation of optical shape sensor based on spun multicore fiber. Mech Syst Signal Process 150:107242. https://doi.org/10.1016/j.ymssp.2020.106700
[38] Meng LX, Xu H, Huang YY (2023) High-accuracy 3D shape sensor based on anti-twist packaged high uniform multicore fiber FBGs. Adv Fiber Mater 5:1467-1477
[39] Mahjoubi S, Tan X, Bao Y (2022) Inverse analysis of strain distributions sensed by distributed fiber optic sensors subject to strain transfer. Mech Syst Signal Process 166:108474. https://doi.org/10.1016/j.ymssp.2021.108474
[40] Lally EM, Reaves M, Horrell E et al (2012) Fiber optic shape sensing for monitoring of flexible structures. Sensors and smart structures technologies for civil. In: SPIE 8345, sensors and smart structures technologies for civil, mechanical, and aerospace systems, 6 April. https://doi.org/10.1117/12.917490
[41] Westbrook PS, Feder KS, Kremp T et al (2014) Integrated optical fiber shape sensor modules based on twisted multicore fiber grating arrays. In: Optical fibers and sensors for medical diagnostics and treatment applications XIV, 20 February, San Francisco. https://doi.org/10.1117/12.2041775
[42] Chen XY, Zhang YN, Qian JW et al (2021) Accuracy of position tracking and fabrication of thin diameter sensor. Meas Sci Technol 32:055202. https://doi.org/10.1088/1361-6501/abdfec
[43] Floris I, Adam JM, Calderón PA et al (2021) Fiber optic shape sensors: a comprehensive review. Opt Lasers Eng 139:106508. https://doi.org/10.1016/j.optlaseng.2020.106508
[44] Chen WH (2006) Differential geometry. Peking University Press, Beijing
[45] Chen XY, Yi XH, Qian JW et al (2020) Updated shape sensing algorithm for space curves with FBG sensors. Opt Lasers Eng 129:106057. https://doi.org/10.1016/j.optlaseng.2020.106057
[46] Chen XY, Zhang YN, Shen LY et al (2020) Fabrication and shape detection of a catheter using fiber bragg grating. Adv Manuf 8(1):107-118
[47] Chen XY, Zhang YN, Qian JW et al (2021) Analysis of strain transfer characteristics of no-substrate and thin diameter sensor. Opt Fiber Technol 61:102367. https://doi.org/10.1016/j.yofte.2020.102367
[48] Laura ET (2008) Mathematics and social utopias in france: olinde rodrigues and his times. Hist Math 35:47-60