Abstract
In order to capture noncooperative targets at close distance, vision-based target detection and tracking have been used as key technologies with great challenges. This paper proposes a novel triangular component detecting and tracking method. In the detection stage, line segments are first extracted from the regions containing triangular spans. Isolated but similar segments are merged under the distance and angle constraints. Then the endpoint distance and area ratios are used as the measurement to determine possible triangle candidates. The geometric property is introduced to discard false-positive candidates. In the tracking stage, the triangle model is characterized by the visual features and geometric relationships of its line segments. An affine transform matrix is constructed to find the correspondence between models and objects in consequent frames. Finally, a line matching–based tracking strategy is designed. Experiments on synthetic and natural images verify the effectiveness of the proposed method in detecting and tracking triangles.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This research is sponsored by The National Science Fund for Distinguished Young Scholars (Grant No. 61725303) and the Fundamental Research Funds for the Central Universities (No. 3102017JG02005).
References
Barnes, N., and Loy, G. (2005). “Real-time regular polygonal sign detection.” Proc., 5th Int. Conf. on Field and Service Robotics, Springer, New York, 55–66.
Barnes, N., Loy, G., and Shae, D. (2010). “The regular polygon detector.” Pattern Recogn., 43(3), 592–602.
Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV library, O’Reilly Media, Sebastopol, CA.
Cai, J., Huang, P. F., Chen, L., and Zhang, B. (2015). “A fast detection method of arbitrary triangles for Tethered Space Robot.” Proc., IEEE Int. Conf. on Robotics and Biomimetics, IEEE, New York, 120–125.
Chen, L., Huang, P. F., Cai, J., Meng, Z. J., and Liu, Z. X. (2016). “A non-cooperative target grasping position prediction model for tethered space robot.” Aerosp. Sci. Technol., 58, 571–581.
Coleshill, E., Oshinowo, L., Rembala, R., Bina, B., Rey, D., and Sindelar, S. (2009). “Dextre: Improving maintenance operations on the International Space Station.” Acta Astronaut., 64(9), 869–874.
Cretual, A., and Chaumetter, F. (2001). “Application of motion-based visual servoing to target tracking.” Int. J. Rob. Res., 20(11), 878–890.
Croitoru, A., and Doytsher, Y. (2004). “Right-angle rooftop polygon extraction in regularized urban areas: Cutting the corners.” Photogramm Rec., 19(108), 311–341.
De la Escalera, A., Armingol, J. M., and Mata, M. (2003). “Traffic sign recognition and analysis for intelligent vehicles.” Image Vision Comput., 21(3), 247–258.
Du, X., Liang, B., Xu, W., and Qiu, Y. (2011). “Pose measurement of large non-cooperative satellite based on collaborative cameras.” Acta Astronaut., 68(11), 2047–2065.
Ferreira, A., Fonseca, M. J., and Jorge, J. A. (2003). “Polygon detection from a set of lines.” Encontro Portugues de Computacao Grafica, IEEE, New York.
Flores-Abad, A., Ma, O., Pham, K., and Ulrich, S. (2014). “A review of space robotics technologies for on-orbit servicing.” Prog. Aerosp. Sci., 68, 1–26.
Gates, J. W., Haseyama, M., and Kitajima, H. (2000). “Real-time polygon extraction from complex images.” Proc., IEEE Int. Symp. on Circuits and System, Vol. 5, IEEE, New York, 309–312.
Huang, P. F., Cai, J., Meng, Z. J., Hu, Z. H., and Wang, D. K. (2014). “Novel method of monocular real-time feature point tracking for tethered space robots.” J. Aerosp. Eng., 04014039.
Huang, P. F., Hu, Z. H., and Zhang, F. (2016a). “Dynamic modelling and coordinated controller designing for the maneuverable tether-net space robot system.” Multibody Syst. Dyn., 36(2), 115–141.
Huang, P. F., Wang, D. K., Meng, Z. J., and Zhang, F. (2016b). “Adaptive postcapture backstepping control for tumbling tethered space robot-target combination.” J. Guid. Control Dyn., 39(1), 150–156.
Huang, P. F., Wang, D. K., Meng, Z. J., Zhang, F., and Liu, Z. X. (2016c). “Impact dynamic modelling and adaptive target capturing control for tethered space robots with uncertainties.” IEEE/ASME Trans. Mechatron., 21(5), 2260–2271.
Huang, P. F., Zhang, F., Meng, Z. J., and Liu, Z. X. (2016d). “Adaptive control for space debris removal with uncertain kinematics, dynamics and states.” Acta Astronaut., 128, 416–430.
Inaba, N., Oda, M., and Asano, M. (2006). “Rescuing a stranded satellite in space—Experimental robotic capture of non-cooperative satellites.” Jpn Soc. Aeronaut. Space Sci. Trans., 48(162), 213–220.
Laha, A., Sen, A., and Sinha, B. P. (2005). “Parallel algorithms for identifying convex and non-convex basis polygons in an image.” Parallel Comput., 31(3), 290–310.
Larouche, B. P., and Zhu, Z. H. (2014). “Autonomous robotic capture of non-cooperative target using visual servoing and motion predictive control.” Auton. Rob., 37(2), 157–167.
Liu, H. M., and Wang, Z. H. (2011). “Detection of arbitrary triangle.” Proc., 4th Int. Congress on Image and Signal Processing, IEEE, New York.
Liu, H. M., and Wang, Z. H. (2014). “PLDD: Point-lines distance distribution for detection of arbitrary triangles, regular polygons and circles.” J. Visual Commun. Image Represent., 25(2), 273–284.
Liu, J., Cui, N., Shen, F., and Rong, S. (2014). “Dynamics of Robotic GEostationary orbit Restorer system during deorbiting.” IEEE Aerosp. Electron. Syst. Mag., 29(11), 36–42.
Liu, Y. H., Wang, H., Wang, C., and Lam, K. K. (2006). “Uncalibrated visual servoing of robots using a depth-independent interaction matrix.” IEEE Trans. Rob., 22(4), 804–817.
Liu, Y. X., Ikenaga, T., and Goto, S. (2007). “An MRF model-based approach to the detection of rectangular shape objects in color images.” Signal Process., 87(11), 2649–2658.
Loy, G., and Barnes, N. (2004). “Fast shape-based road sign detection for a driver assistance system.” Proc., IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Vol. 1, IEEE, New York, 70–75.
Meng, Z. J., Wang, B. H., and Huang, P. F. (2017). “Twist suppression method of tethered towing for spinning space debris.” J. Aerosp. Eng., 04017012.
OpenCV version 2.4.3 [Computer software]. Intel Corporation, Santa Clara, CA.
Park, J., and Yoon, K. (2015). “Real-time line matching from stereo images using a nonparametric transform of spatial relations and texture information.” Opt. Eng., 54(2), 023106.
Ramirez, V. A., Gutierrez, S. A. M., and Yanez, R. E. S. (2011). “Quadrilateral detection using genetic algorithms.” Computación y Sistemas, 15(2), 181–193.
Thienel, J. K., VanEepoel, J. M., and Sanner, R. M. (2006). “Accurate state estimation and tracking of a non-cooperative target vehicle.” Proc., AIAA Guidance, Navigation, and Control Conf., AIAA, Reston, VA, 5511–5522.
Visual Studio [Computer software]. Microsoft, Redmond, WA.
Von Gioi, R. G., Jakubowicz, J., Morel, J. M., and Randall, G. (2008). “LSD: A fast line segment detector with a false detection control.” IEEE Trans. Pattern Anal., 32(4), 722–732.
Wang, D. K., Huang, P. F., Cai, J., and Meng, Z. J. (2014). “Coordinated control of tethered space robot using mobile tether attachment point in approaching phase.” Adv. Space Res., 54(6), 1077–1091.
Wang, H., Yang, B., Liu, Y., Chen, W., Liang, X., and Pfeifer, R. (2017). “Visual servoing of soft robot manipulator in constrained environments with an adaptive controller.” IEEE/ASME Trans. Mech., 22(1), 41–51.
Xu, W. F., Liang, B., Li, C., and Xu, Y. S. (2010). “Autonomous rendezvous and robotic capturing of non-cooperative target in space.” Robotica, 28(05), 705–718.
Xu, W. F., Liang, B., Li, B., and Xu, Y. S (2011). “A universal on-orbit servicing system used in the geostationary orbit.” Adv. Space Res., 48(1), 95–119.
Information & Authors
Information
Published In
Journal of Aerospace Engineering
Volume 31 • Issue 3 • May 2018
Copyright
©2018 American Society of Civil Engineers.
History
Received: Jun 15, 2017
Accepted: Oct 13, 2017
Published online: Feb 2, 2018
Published in print: May 1, 2018
Discussion open until: Jul 2, 2018
ASCE Technical Topics:
- Design (by type)
- Detection methods
- Distance measurement
- Engineering fundamentals
- Frames
- Geometrics
- Highway and road design
- Mathematical functions
- Mathematics
- Matrix (mathematics)
- Measurement (by type)
- Methodology (by type)
- Research methods (by type)
- Structural engineering
- Structural members
- Structural systems
- Tracking
- Verification
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.