用于机器人制孔的单目视觉系统开发

Wei-dong ZHU; Biao MEI; Guo-rui YAN; Ying-lin KE

doi:10.1631/jzus.C1300379

Your Location：

Home >

Browse articles >

用于机器人制孔的单目视觉系统开发

计算机与自动化 | Updated：2022-05-19

- 用于机器人制孔的单目视觉系统开发
- Development of a monocular vision system for robotic drilling
- 信息与电子工程前沿（英文） 2014年15卷第8期页码：593-606
- Affiliations：
  
  1.Department of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China
  2.The State Key Lab of Fluid Power Transmission and Control, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  [ "Wei-dong ZHU, E-mail: wdzhu@zju.edu.cn" ]
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 51205352 and 51221004)
- DOI：10.1631/jzus.C1300379
  中图分类号： TP391.4
- 收稿：2013-12-29，
  
  修回：2014-;7-16，
  
  纸质出版：2014-08
- Accepted：
Scan QR Code
用于机器人制孔的单目视觉系统开发[J]. 信息与电子工程前沿（英文）, 2014,15(8):593-606.

Wei-dong ZHU, Biao MEI, Guo-rui YAN, et al. Development of a monocular vision system for robotic drilling[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(8): 593-606.
用于机器人制孔的单目视觉系统开发[J]. 信息与电子工程前沿（英文）, 2014,15(8):593-606. DOI： 10.1631/jzus.C1300379.

Wei-dong ZHU, Biao MEI, Guo-rui YAN, et al. Development of a monocular vision system for robotic drilling[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(8): 593-606. DOI： 10.1631/jzus.C1300379.

摘要

研究目的

在航空结构件机器人制孔中，通常通过误差测量和补偿保证制孔位置精度。本文旨在开发一种低成本、高精度的视觉系统，通过集成鲁棒的椭圆特征提取算法、实用的视觉系统标定方法，实现对刀具和工件之间相对误差的精确测量。

创新要点

视觉测量相关研究中缺乏对视觉系统工作原理的深入阐释；视觉系统误差测量原理的精确阐述，为视觉系统的开发和测量精度的提高提供了理论基础。机器人制孔环境中存在大量噪声和环境干扰因素，视觉系统中集成的特征提取算法应具有较高的鲁棒性；基于显著性的椭圆轮廓提取算法可实现鲁棒、精确的基准孔检测。工业应用通常要求视觉系统的标定方法兼具实用性和精确性；本文方法提供了一种实用、精确、可同时实现相机和手眼关系标定的标定方法。

方法提亮

精确阐释了视觉系统的工作原理，为后续相机刀具中心点和视觉系统标定方法的确定提供了理论依据。通过集成显著性计算、投票方法和Snake模型，开发了一种鲁棒、精确的椭圆轮廓特征提取算法（图8）。提出了一种基于专用标定板的、可同时实现相机内参数和手眼关系标定的视觉系统标定方法，该方法可避免测量过程引入Abbe误差（图12）。

重要结论

本文研究了视觉测量系统的工作原理，并结合提出的椭圆轮廓提取算法、视觉系统标定方法，开发了一种低成本、满足机器人制孔精度要求的单目视觉测量系统。在机器人制孔系统平台上的实验证实，本文提出的视觉系统满足航空工业对制孔精度的要求，特征提取算法和标定方法鲁棒、有效。

Abstract

Robotic drilling for aerospace structures demands a high positioning accuracy of the robot

which is usually achieved through error measurement and compensation. In this paper

we report the development of a practical monocular vision system for measurement of the relative error between the drill tool center point (TCP) and the reference hole. First

the principle of relative error measurement with the vision system is explained

followed by a detailed discussion on the hardware components

software components

and system integration. The elliptical contour extraction algorithm is presented for accurate and robust reference hole detection. System calibration is of key importance to the measurement accuracy of a vision system. A new method is proposed for the simultaneous calibration of camera internal parameters and hand-eye relationship with a dedicated calibration board. Extensive measurement experiments have been performed on a robotic drilling system. Experimental results show that the measurement accuracy of the developed vision system is higher than 0.15 mm

which meets the requirement of robotic drilling for aircraft structures.

关键词

Keywords

references

J.M. Armingol , , , J. Otamendi , , , A. de la Escalera , , , 等 . . Statistical pattern modeling in vision-based quality control systems . . J. Intell. Robot. Syst. , , 2003 . . 37 ( ( 3 ): ): 321 - - 336 . . DOI: 10.1023/A:1025489610281 http://doi.org/10.1023/A:1025489610281 . .

H. Bilen , , , M. Hocaoglu , , , M. Unel , , , 等 . . Developing robust vision modules for microsystems applications . . Mach. Vis. Appl. , , 2012 . . 23 ( ( 1 ): ): 25 - - 42 . . DOI: 10.1007/s00138-010-0267-y http://doi.org/10.1007/s00138-010-0267-y . .

G.M. Bone , , , D. Capson . . Vision-guided fixtureless assembly of automotive components . . Robot. Comput.- Integr. Manuf. , , 2003 . . 19 ( ( 1-2 ): ): 79 - - 87 . . DOI: 10.1016/S0736-5845(02)00064-9 http://doi.org/10.1016/S0736-5845(02)00064-9 . .

G. Bradski , , , A. Kaehler . . Learning OpenCV: Computer Vision with the OpenCV Library . . O'reilly, Sebastopol, CA , , 2008 . . .

S. Chen , , , Y. Zhang , , , T. Qiu , , , 等 . . Robotic welding systems with vision-sensing and self-learning neuron control of arc welding dynamic process . . J. Intell. Robot. Syst. , , 2003 . . 36 ( ( 2 ): ): 191 - - 208 . . DOI: 10.1023/A:1022652706683 http://doi.org/10.1023/A:1022652706683 . .

R. DeVlieg , , , K. Sitton , , , E. Feikert , , , 等 . . ONCE (ONe-sided Cell End effector) Robotic Drilling System . . SAE Technical Paper 2002-01-2626 , , 2002 . . DOI: 10.4271/2002-01-2626 http://doi.org/10.4271/2002-01-2626 . .

F. Dornaika , , , R. Horaud . . Simultaneous robot-world and hand-eye calibration . . IEEE Trans. Robot. Autom. , , 1998 . . 14 ( ( 4 ): ): 617 - - 622 . . DOI: 10.1109/70.704233 http://doi.org/10.1109/70.704233 . .

D. Eberli , , , D. Scaramuzza , , , S. Weiss , , , 等 . . Vision based position control for MAVs using one single circular landmark . . J. Intell. Robot. Syst. , , 2010 . . 61 ( ( 1-4 ): ): 495 - - 512 . . DOI: 10.1007/s10846-010-9494-8 http://doi.org/10.1007/s10846-010-9494-8 . .

A. Fitzgibbon , , , M. Pilu , , , R.B. Fisher . . Direct least square fitting of ellipses . . IEEE Trans. Pattern Anal. Mach. Intell. , , 1999 . . 21 ( ( 5 ): ): 476 - - 480 . . DOI: 10.1109/34.765658 http://doi.org/10.1109/34.765658 . .

D.A. Forsyth , , , J. Ponce . . Computer Vision: a Modern Approach (2nd Ed.) . . Prentice-Hall, Englewood Cliffs, New Jersey , , 2011 . . .

A. Ibarguren , , , J.M. Martínez-Otzeta , , , I. Maurtua . . Particle filtering for industrial 6DOF visual servoing . . J. Intell. Robot. Syst. , , 2014 . . 74 ( ( 3-4 ): ): 689 - - 696 . . DOI: 10.1007/s10846-013-9854-2 http://doi.org/10.1007/s10846-013-9854-2 . .

B. Lee , , , Y. Tarng . . Surface roughness inspection by computer vision in turning operations . . Int. J. Mach. Tool. Manuf. , , 2001 . . 41 ( ( 9 ): ): 1251 - - 1263 . . DOI: 10.1016/S0890-6955(01)00023-2 http://doi.org/10.1016/S0890-6955(01)00023-2 . .

S. Malassiotis , , , M.G. Strintzis . . Stereo vision system for precision dimensional inspection of 3D holes . . Mach. Vis. Appl. , , 2003 . . 15 ( ( 2 ): ): 101 - - 113 . . DOI: 10.1007/s00138-003-0132-3 http://doi.org/10.1007/s00138-003-0132-3 . .

A. Malti . . Hand–eye calibration with epipolar constraints: application to endoscopy . . Robot. Auton. Syst. , , 2012 . . 61 ( ( 2 ): ): 161 - - 169 . . DOI: 10.1016/j.robot.2012.09.029 http://doi.org/10.1016/j.robot.2012.09.029 . .

J.M.C.S. Motta , , , G.C. de Carvalho , , , R. McMaster . . Robot calibration using a 3D vision-based measurement system with a single camera . . Robot. Comput.-Integr. Manuf. , , 2001 . . 17 ( ( 6 ): ): 487 - - 497 . . DOI: 10.1016/S0736-5845(01)00024-2 http://doi.org/10.1016/S0736-5845(01)00024-2 . .

H.V. Neto , , , U. Nehmzow . . Real-time automated visual inspection using mobile robots . . J. Intell. Robot. Syst. , , 2007 . . 49 ( ( 3 ): ): 293 - - 307 . . DOI: 10.1007/s10846-007-9146-9 http://doi.org/10.1007/s10846-007-9146-9 . .

T. Olsson , , , M. Haage , , , H. Kihlman , , , 等 . . Cost-efficient drilling using industrial robots with high-bandwidth force feedback . . Robot. Comput.-Integr. Manuf. , , 2010 . . 26 ( ( 1 ): ): 24 - - 38 . . DOI: 10.1016/j.rcim.2009.01.002 http://doi.org/10.1016/j.rcim.2009.01.002 . .

N. Otsu . . A threshold selection method from gray-level histograms . . IEEE Trans. Syst. Man Cybern. , , 1979 . . 9 ( ( 1 ): ): 62 - - 66 . . DOI: 10.1109/TSMC.1979.4310076 http://doi.org/10.1109/TSMC.1979.4310076 . .

T.P. Pachidis , , , J.N. Lygouras . . Vision-based path generation method for a robot-based arc welding system . . J. Intell. Robot. Syst. , , 2007 . . 48 ( ( 3 ): ): 307 - - 331 . . DOI: 10.1007/s10846-006-9076-y http://doi.org/10.1007/s10846-006-9076-y . .

M. Simonvsky . . Ellipse Detection Using 1D Hough Transform . . Available from http://www.mathworks.com/matlabcentral/fileexchange/33970-ellipse-detection-using-1d-hough-transform http://www.mathworks.com/matlabcentral/fileexchange/33970-ellipse-detection-using-1d-hough-transform , , 2011 . . .

K.H. Strobl , , , G. Hirzinger . . More accurate camera and hand-eye calibrations with unknown grid pattern dimensions . . IEEE Int. Conf. on Robotics and Automation , , 2008 . . p.1398 - - 1405 . . DOI: 10.1109/ROBOT.2008.4543398 http://doi.org/10.1109/ROBOT.2008.4543398 . .

K.H. Strobl , , , W. Sepp , , , G. Hirzinger . . On the issue of camera calibration with narrow angular field of view . . IEEE/RSJ Int. Conf. on Intelligent Robots and Systems , , 2009 . . p.309 - - 315 . . DOI: 10.1109/IROS.2009.5354776 http://doi.org/10.1109/IROS.2009.5354776 . .

S. Suzuki . . Topological structural analysis of digitized binary images by border following . . Comput. Vis. Graph. Image Process. , , 1985 . . 30 ( ( 1 ): ): 32 - - 46 . . DOI: 10.1016/0734-189X(85)90016-7 http://doi.org/10.1016/0734-189X(85)90016-7 . .

P. Thompson , , , J. Hartmann , , , E. Feikert , , , 等 . . Flex Track for Use in Production . . SAE Technical Paper 2005-01-3318 , , 2005 . . DOI: 10.4271/2005-01-3318 http://doi.org/10.4271/2005-01-3318 . .

R. Tsai . . A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses . . IEEE J. Robot. Autom. , , 1987 . . 3 ( ( 4 ): ): 323 - - 344 . . DOI: 10.1109/JRA.1987.1087109 http://doi.org/10.1109/JRA.1987.1087109 . .

P. Webb , , , S. Eastwood , , , N. Jayaweera , , , 等 . . Automated aerostructure assembly . . Ind. Robot. , , 2005 . . 32 ( ( 5 ): ): 383 - - 387 . . DOI: 10.1108/01439910510614646 http://doi.org/10.1108/01439910510614646 . .

D.J. Williams , , , M. Shah . . A fast algorithm for active contours and curvature estimation . . CVGIP Image Understand. , , 1992 . . 55 ( ( 1 ): ): 14 - - 26 . . DOI: 10.1016/1049-9660(92)90003-L http://doi.org/10.1016/1049-9660(92)90003-L . .

Q. Zhan , , , X. Wang . . Hand–eye calibration and positioning for a robot drilling system . . Int. J. Adv. Manuf. Technol. , , 2012 . . 61 ( ( 5-8 ): ): 691 - - 701 . . DOI: 10.1007/s00170-011-3741-4 http://doi.org/10.1007/s00170-011-3741-4 . .

Z. Zhang . . A flexible new technique for camera calibration . . IEEE Trans. Pattern Anal. Mach. Intell. , , 2000 . . 22 ( ( 11 ): ): 1330 - - 1334 . . DOI: 10.1109/34.888718 http://doi.org/10.1109/34.888718 . .

Z. Zhao , , , Y. Weng . . A flexible method combining camera calibration and hand–eye calibration . . Robotica , , 2013 . . 31 ( ( 5 ): ): 747 - - 756 . . DOI: 10.1017/S0263574713000040 http://doi.org/10.1017/S0263574713000040 . .

Y. Zhou , , , B.J. Nelson , , , B. Vikramaditya . . Integrating optical force sensing with visual servoing for microassembly . . J. Intell. Robot. Syst. , , 2000 . . 28 ( ( 3 ): ): 259 - - 276 . . DOI: 10.1023/A:1008136711577 http://doi.org/10.1023/A:1008136711577 . .

W. Zhu , , , W. Qu , , , L. Cao , , , 等 . . An off-line programming system for robotic drilling in aerospace manufacturing . . Int. J. Adv. Manuf. Technol. , , 2013 . . 68 ( ( 9-12 ): ): 2535 - - 2545 . . DOI: 10.1007/s00170-013-4873-5 http://doi.org/10.1007/s00170-013-4873-5 . .

X. Zou , , , H. Zou , , , J. Lu . . Virtual manipulator-based binocular stereo vision positioning system and errors modelling . . Mach. Vis. Appl. , , 2012 . . 23 ( ( 1 ): ): 43 - - 63 . . DOI: 10.1007/s00138-010-0291-y http://doi.org/10.1007/s00138-010-0291-y . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据