An Intelligent Seam Detection Method for Welding Robots Based on Image Guided Point Cloud Registration
Publication: Construction Research Congress 2024
ABSTRACT
Welding robots are often employed to improve the welding efficiency and quality of steel structures. In the past few years, weld seam detection technologies based on structured light have undergone huge advances. However, due to the limited measuring range of structured light sensors, high accuracy of workpiece placement is required by most popular approaches in order to avoid invalid sampling. This fails to meet the actual needs of manufacturing. To overcome this burden, a two-step seam detection method is proposed in this study. Firstly, a symbol-assisted 2D digital image contour detection method is employed to obtain the projection of the workpiece in the horizontal plane. Meanwhile, the actual point cloud and the model point cloud of the workpiece are generated based on projected image and CAD model, further calculating the transformation matrix between the two point clouds. Secondly, a linear structured light vision sensor is used to detect weld seams, whose sampling poses are adjusted by the obtained transformation matrix. The robustness and accuracy of the proposed method are demonstrated by simulation experiment results.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Besl, P. J., and McKay, N. D. (1992). “A method for registration of 3-D shapes.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 239–256.
Canny, J. (1987). “A Computational Approach to Edge Detection.” Readings in Computer Vision, M. A. Fischler, and O. Firschein, eds., Morgan Kaufmann, San Francisco (CA), 184–203.
Dinham, M., and Fang, G. (2013). “Autonomous weld seam identification and localisation using eye-in-hand stereo vision for robotic arc welding.” Robotics and Computer-Integrated Manufacturing, 29(5), 288–301.
Fan, J., Jing, F., Yang, L., Long, T., and Tan, M. (2019). “A precise seam tracking method for narrow butt seams based on structured light vision sensor.” Optics & Laser Technology, 109, 616–626.
Geng, Y., Lai, M., Tian, X., Xu, X., Jiang, Y., and Zhang, Y. (2023). “A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision.” Robotics and Computer-Integrated Manufacturing, 79, 102433.
Huang, W., and Kovacevic, R. (2012). “Development of a real-time laser-based machine vision system to monitor and control welding processes.” The International Journal of Advanced Manufacturing Technology, 63(1), 235–248.
Kiddee, P., Fang, Z., and Tan, M. (2016). “An automated weld seam tracking system for thick plate using cross mark structured light.” The International Journal of Advanced Manufacturing Technology, 87(9), 3589–3603.
Liu, J., Jiao, T., Li, S., Wu, Z., and Chen, Y. F. (2022). “Automatic seam detection of welding robots using deep learning.” Automation in Construction, 143, 104582.
Otsu, N. (1979). “A Threshold Selection Method from Gray-Level Histograms.” IEEE Transactions on Systems, Man, and Cybernetics, 9(1), 62–66.
Xu, P., Tang, X., and Yao, S. (2008). “Application of circular laser vision sensor (CLVS) on welded seam tracking.” Journal of Materials Processing Technology, 205(1), 404–410.
Zou, Y., and Chen, T. (2018). “Laser vision seam tracking system based on image processing and continuous convolution operator tracker.” Optics and Lasers in Engineering, 105, 141–149.
Information & Authors
Information
Published In
Construction Research Congress 2024
Pages: 876 - 884
History
Published online: Mar 18, 2024
ASCE Technical Topics:
- Automation and robotics
- Buildings
- Construction engineering
- Construction management
- Construction methods
- Detection methods
- Engineering fundamentals
- Equipment and machinery
- Methodology (by type)
- Probe instruments
- Project management
- Smart buildings
- Steel structures
- Structural engineering
- Structures (by type)
- Systems engineering
- Welding
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.