AR-assisted robot welding programming

doi:10.1007/s40436-019-00283-0

Advances in Manufacturing ›› 2020, Vol. 8 ›› Issue (1): 40-48.doi: 10.1007/s40436-019-00283-0

AR-assisted robot welding programming

S. K. Ong, A. Y. C. Nee, A. W. W. Yew, N. K. Thanigaivel

Department of Mechanical Engineering, Faculty of Engineering, National University of Singapore, Singapore, Singapore

收稿日期:2019-01-10 修回日期:2019-05-10 出版日期:2020-03-25 发布日期:2020-03-07
通讯作者: S. K. Ong E-mail:mpeongsk@nus.edu.sg
基金资助:
This research is supported by the Singapore A*STAR Agency for Science, Technology and Research, Science Engineering Research Council, Industrial Robotic Programme on Interface for Human Robot Interaction (Grant No. 1225100001) and the Public Sector Research Funding Programme on Embedding Powerful Computer Applications in Ubiquitous Augmented Reality Environments (Grant No. 1521200081).

AR-assisted robot welding programming

S. K. Ong, A. Y. C. Nee, A. W. W. Yew, N. K. Thanigaivel

Department of Mechanical Engineering, Faculty of Engineering, National University of Singapore, Singapore, Singapore

Received:2019-01-10 Revised:2019-05-10 Online:2020-03-25 Published:2020-03-07
Contact: S. K. Ong E-mail:mpeongsk@nus.edu.sg
Supported by:
This research is supported by the Singapore A*STAR Agency for Science, Technology and Research, Science Engineering Research Council, Industrial Robotic Programme on Interface for Human Robot Interaction (Grant No. 1225100001) and the Public Sector Research Funding Programme on Embedding Powerful Computer Applications in Ubiquitous Augmented Reality Environments (Grant No. 1521200081).

摘要/Abstract

摘要： Robotic welding demands high accuracy and precision. However, robot programming is often a tedious and time-consuming process that requires expert knowledge. This paper presents an augmented reality assisted robot welding task programming (ARWP) system using a user-friendly augmented reality (AR) interface that simplifies and speeds up the programming of robotic welding tasks. The ARWP system makes the programming of robot welding tasks more user-friendly and reduces the need for trained programmers and expertise in specific robotic systems. The AR interface simplifies the definition of a welding path as well as the welding gun orientation, and the system; the system can locate the welding seam of a workpiece quickly and generate a viable welding path based on the user input. The developed system is integrated with the touch-sensing capability of welding robots in order to locate the welding path accurately based on the user input, for fillet welding. The system is applicable to other welding processes and methods of seam localization. The system implementation is described and evaluated with a case study.

The full text can be downloaded at https://link.springer.com/content/pdf/10.1007%2Fs40436-019-00283-0.pdf

关键词: Augmented reality (AR), Robot programming, Welding, Seam tracking

Abstract: Robotic welding demands high accuracy and precision. However, robot programming is often a tedious and time-consuming process that requires expert knowledge. This paper presents an augmented reality assisted robot welding task programming (ARWP) system using a user-friendly augmented reality (AR) interface that simplifies and speeds up the programming of robotic welding tasks. The ARWP system makes the programming of robot welding tasks more user-friendly and reduces the need for trained programmers and expertise in specific robotic systems. The AR interface simplifies the definition of a welding path as well as the welding gun orientation, and the system; the system can locate the welding seam of a workpiece quickly and generate a viable welding path based on the user input. The developed system is integrated with the touch-sensing capability of welding robots in order to locate the welding path accurately based on the user input, for fillet welding. The system is applicable to other welding processes and methods of seam localization. The system implementation is described and evaluated with a case study.

The full text can be downloaded at https://link.springer.com/content/pdf/10.1007%2Fs40436-019-00283-0.pdf

Key words: Augmented reality (AR), Robot programming, Welding, Seam tracking

S. K. Ong, A. Y. C. Nee, A. W. W. Yew, N. K. Thanigaivel. AR-assisted robot welding programming[J]. Advances in Manufacturing, 2020, 8(1): 40-48.

参考文献

1. Azuma RT (1997) A survey of augmented reality. Teleoperators Virtual Environ 6(4):355-385
2. Wang X, Ong SK, Nee AYC (2016) A comprehensive survey of augmented reality assembly research. Adv Manuf 4(1):1-22
3. Fang HC, Ong SK, Nee AYC (2014) Novel AR-based interface for human-robot interaction and visualization. Adv Manuf 2(4):275-288
4. Lambrecht J, Kruger J (2012) Spatial programming for industrial robots based on gestures and augmented reality. In:Proceedings of IEEE/RSJ international conference on intelligent robots and systems, Washington DC, 7-12 Oct 2012, pp 466-472
5. Akan B, Ameri A, Çürüklü B et al (2011) Intuitive industrial robot programming through incremental multimodal language and augmented reality. In:Proceedings of 2011 IEEE international conference on robotics and automation, Shanghai, China, 9-13 May 2011, pp 3934-3939
6. Ni D, Yew AWW, Ong SK et al (2017) Haptic and visual augmented reality interface for programming welding robots. Adv Manuf 5(3):191-198
7. Fang HC, Ong SK, Nee AYC (2017) Adaptive pass planning and optimization for robotic welding of complex joints. Adv Manuf 5(2):93-104
8. Reinhart G, Munzert U, Vogl W (2008) A programming system for robot-based remote-laser-welding with conventional optics. CIRP Ann Manuf Technol 57(1):37-40
9. Andersen RS, Bogh S, Moeslund TB et al (2015) Intuitive task programming of stud welding robots for ship construction. In:Proceedings of the 2015 IEEE international conference on industrial technology, Washington DC, 17-19 Mar 2015, pp 3302-3307
10. Zaeh MF, Vogl W (2006) Interactive laser-projection for programming industrial robots. In:Proceedings of IEEE/ACM international symposium on mixed and augmented reality, Washington DC, 22-25 Oct 2006, pp 125-128
11. Hiroi Y, Obata K, Suzuki K et al (2015) Remote welding robot manipulation using multi-view images. In:Proceedings of the 2015 IEEE international symposium on mixed and augmented reality, Washington DC, 29 Sept -3 Oct 2015, pp 128-131
12. Antonelli D, Astanin S, Galetto M et al (2013) Training by demonstration for welding robots by optical trajectory tracking. Procedia CIRP 12:145-150
13. Yoshikawa T (1985) Manipulability of robotic mechanisms. Int J Robot Res 4(2):3-9
14. Best PJ, McKay ND (1992) A method for registration of 3D shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239-256
15. Garrido-Jurado S, Muñoz-Salinas R, Madrid-Cuevas FJ et al (2014) Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn 47(6):2280-2292
16. Quigley M, Conley K, Gerkey BP et al (2009) ROS:an opensource robot operating system. In:Proceedings of 2009 IEEE international conference on robotics and automation, Kobe, Japan, 12-17 May, pp 5-10
17. Smits R (2017) KDL:kinematics and dynamics library. http://www.orocos.org/kdl. Accessed 12 Feb 2017
18. Şucan IA, Moll M, Kavraki LE (2012) The open motion planning library. IEEE Robot Autom Mag 19(4):72-82

[1]	S. K. Ong, X. Wang, A. Y. C. Nee. 3D bare-hand interactions enabling ubiquitous interactions with smart objects[J]. Advances in Manufacturing, 2020, 8(2): 133-143.
[2]	M. Wasif Safeen, P. Russo Spena, G. Buffa, D. Campanella, A. Masnata, L. Fratini. Effect of position and force tool control in friction stir welding of dissimilar aluminum-steel lap joints for automotive applications[J]. Advances in Manufacturing, 2020, 8(1): 59-71.
[3]	M. Kimura, S. Iwamoto, M. Kusaka, K. Kaizu, Y. Nakatani, M. Takahashi. Effect of weld faying part groove shape on reduction of inner flash in steel pipe joints fabricated by friction welding[J]. Advances in Manufacturing, 2019, 7(4): 411-422.
[4]	M. Mazar Atabaki, N. Yazdian, R. Kovacevic. Hybrid laser/arc welding of thick high-strength steel in different configurations[J]. Advances in Manufacturing, 2018, 6(2): 176-188.
[5]	D. Ni, A. W. W. Yew, S. K. Ong, A. Y. C. Nee. Haptic and visual augmented reality interface for programming welding robots[J]. Advances in Manufacturing, 2017, 5(3): 191-198.
[6]	H. C. Fang, S. K. Ong, A. Y. C. Nee. Adaptive pass planning and optimization for robotic welding of complex joints[J]. Advances in Manufacturing, 2017, 5(2): 93-104.
[7]	G. Buffa, M. De Lisi, E. Sciortino, L. Fratini. Dissimilar titanium/aluminum friction stir welding lap joints by experiments and numerical simulation[J]. Advances in Manufacturing, 2016, 4(4): 287-295.
[8]	Achilles Vairis, George Papazafeiropoulos, Andreas-Marios Tsainis. A comparison between friction stir welding, linear friction welding and rotary friction welding[J]. Advances in Manufacturing, 2016, 4(4): 296-304.
[9]	Antonello Astarita, Mario Coppola, Sergio Esposito, Mariacira Liberini, Leandro Maio, Ilaria Papa, Fabio Scherillo, Antonino Squillace. Experimental characterization of Ti6Al4V T joints welded through linear friction welding technique: microstructure and NDE[J]. Advances in Manufacturing, 2016, 4(4): 305-313.
[10]	Ying Fu, Wen-Ya Li, Xia-Wei Yang, Tie-Jun Ma, Achilles Vairis. The effects of forging pressure and temperature field on residual stresses in linear friction welded Ti6Al4V joints[J]. Advances in Manufacturing, 2016, 4(4): 314-321.
[11]	J. Bellmann, J. Lueg-Althoff, S. Schulze, S. Gies, E. Beyer, A. E. Tekkaya. Measurement and analysis technologies for magnetic pulse welding: established methods and new strategies[J]. Advances in Manufacturing, 2016, 4(4): 322-339.
[12]	Prakash KumarSahu, Kanchan Kumari, Sukhomay Pal, Surjya K. Pal. Hybrid fuzzy-grey-Taguchi based multi weld quality optimization of Al/Cu dissimilar friction stir welded joints[J]. Advances in Manufacturing, 2016, 4(3): 237-247.
[13]	Li-Feng Fan, Jia-Xin Yan, Ying Gao, Jian-Bin Yun. Research on deformation characteristics of JCOE forming in large diameter welding pipe[J]. Advances in Manufacturing, 2016, 4(3): 268-277.
[14]	X. Wang, S. K. Ong, A. Y. C. Nee. A comprehensive survey of augmented reality assembly research[J]. Advances in Manufacturing, 2016, 4(1): 1-22.
[15]	M. Mohammed Asif, Kulkarni Anup Shrikrishna, P. Sathiya. Optimization of process parameters of friction welding of UNS S31803 duplex stainless steels joints[J]. Advances in Manufacturing, 2016, 4(1): 55-65.

AR-assisted robot welding programming

AR-assisted robot welding programming

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价