Efficient Full-Field Vibration Measurements and Operational Modal Analysis Using Neuromorphic Event-Based Imaging
Publication: Journal of Engineering Mechanics
Volume 144, Issue 7
Abstract
Traditional vibration measurement typically requires physically attached sensors, such as accelerometers and strain gauges. However, these discrete-point sensors provide only low spatial resolution vibration measurements, potentially foregoing valuable structural information such as localized damage. Noncontact optical measurement methods such as laser vibrometers can achieve high spatial resolution vibration measurements but only through time-consuming sequential measurements and are not cost-effective. As an alternative to traditional vibration measurement methods, digital video cameras are relatively low-cost, agile, and offer noncontact, simultaneous high spatial resolution measurements where every pixel on the structure becomes a measurement point. However, regular digital video cameras are frame-based where each pixel simultaneously performs temporally uniform (synchronous) measurements containing large amounts of redundant (background) data, which consumes considerable resources for video data measurement, management, and processing. To alleviate such a challenge, this work explores the use of event-based neuromorphic imagers, specifically silicon retinas, an efficient alternative to traditional frame-based video cameras, to perform full-field vibration measurements and operational modal analysis. By imitating biological vision, each silicon retina pixel independently and asynchronously records only intensity change events that contain structural motion information while excluding redundant (background) information. Such an asynchronous event-based data measurement mechanism allows for structural motion to be captured on the microsecond scale in an extremely data-efficient manner, which could benefit real-time vibration measurement and control applications. This study takes the first step toward these applications by formulating an existing video frame-based full-field operational modal analysis technique in the event-based, asynchronous silicon retina measurement framework. Specifically, local phase-based motion extraction and blind source separation are used to automatically and efficiently extract full-field vibration and dynamics parameters from silicon retina measurements. The developed method is validated by laboratory experiments on a bench-scale cantilever beam.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The authors would like to acknowledge the support of the Los Alamos National Laboratory Institute for Material science that sponsored this work in the form of a 2016 Rapid Response grant. The authors would also like to acknowledge the Los Alamos National Laboratory Lab Directed Research and Development (LDRD) program. This program has supported this work in the form of a Director’s funded postdoctoral fellowship for Yongchao Yang (20150708PRD2). We would also like to acknowledge the Los Alamos National Laboratory—Chonbuk National University Engineering Institute—Korea for supporting Charles Dorn for part of the duration of this work.
References
Aeschlimann, F., E. Allier, L. Fesquet, and M. Renaudin. 2005. “Spectral analysis of level-crossing sampling scheme.” In Proc., Int. Conf. on Sampling Theory and Application. Samsun, Turkey.
Allen, M., P. Reu, and S. Braun. 2017. “Full-field, non-contact vibration measurement methods: Comparison and applications.” Mech. Syst. Sig. Process. 86 (Part B): 1–116.
Barranco, F., C. Fermuller, and Y. Aloimonos. 2014. “Contour motion estimation for asynchronous event-driven cameras.” Proc. IEEE 102 (10): 1537–1556.
Barranco, F., C. Fermuller, and Y. Aloimonos. 2015. “Bio-inspired motion estimation.” In Proc., Int. Work-Conf. on Artificial Neural Networks. Cham, Switzerland: Springer.
Benosman, R., C. Clercq, X. Lagorce, S.-H. Leng, and C. Bartolozzi. 2014. “Event-based visual flow.” IEEE Trans. Neural Networks Learn. Syst. 25 (2): 407–417. https://doi.org/10.1109/TNNLS.2013.2273537.
Benosman, R., S.-H. Leng, C. Clercq, C. Bartolozzi, and M. Srinivasan. 2012. “Asynchronous frameless event-based optical flow.” Neural Networks 27: 32–37. https://doi.org/10.1016/j.neunet.2011.11.001.
Brickner, R., and C. Ventura. 2015. Introduction to operational modal analysis. West Sussex, UK: Wiley.
Brosch, T., S. Tschechne, and H. Neumann. 2015. “On event-based optical flow detection.” Front. Neurosci. 9: 137 https://doi.org/10.3389/fnins.2015.00137.
Castellini, P. 2006. “Laser Doppler vibrometry: Development of advanced solutions answering to technology’s needs.” Mech. Syst. Sig. Process. 20 (6): 1265–1285. https://doi.org/10.1016/j.ymssp.2005.11.015.
Chen, J., N. Wadhwa, Y. Cha, F. Durand, W. Freeman, and O. Buyukozturk. 2015. “Modal identification of simple structures with high-speed video using motion magnification.” J. Sound Vibr. 345: 58–71. https://doi.org/10.1016/j.jsv.2015.01.024.
Conradt, J., R. Berner, M. Cook, and T. Delbruck. 2009. “An embedded AER dynamic vision sensor for low-latency pole balancing.” In Proc., 12th Int. Conf. on Computer Vision Workshops (ICCV Workshops), 780–785. New York: IEEE.
Delbruck, T. 2008. “Frame-free dynamic digital vision.” In Proc., Int. Symp. on Secure-Life Electronics, Advanced Electronics for Quality Life and Society. Tokyo: Univ. of Tokyo.
Delbruck, T., and M. Lang. 2015. “Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor.” In Vol. 7 of Neuromorphic engineering systems and applications. Lausanne, Switzerland: Frontiers.
Delbruck, T., and S.-C. Liu. 2012. Event-based silicon retinas and cochleas. Vienna, Austria: Springer.
Di Maio, D., and D. Ewins. 2011. “Continuous Scan, a method for performing modal testing using meaningful measurement parameters: Part I.” Mech. Syst. Sig. Process. 25 (8): 3027–3042. https://doi.org/10.1016/j.ymssp.2011.05.018.
Doebling, S., C. Farrar, and M. Prime. 1998. “A summary review of vibration-based damage identification methods.” Shock Vibr. Digest 30 (2): 91–105.
Ewins, D. 2000. Modal testing: Theory, practice, and application. Baldock, UK: Research Studies Press.
Fan, W., and P. Qiao. 2011. “Vibration-based damage identification methods: A review and comparative study.” Struct. Health Monit. 10 (1): 83–111. https://doi.org/10.1177/1475921710365419.
Feeny, B., and R. Kappagantu. 1998. “On the physical interpretation of proper orthogonal modes in vibration.” J. Sound Vibr. 211 (4): 607–616. https://doi.org/10.1006/jsvi.1997.1386.
Fleet, D., and A. Jepson. 1990. “Computation of component image velocity from local phase information.” Int. J. Comput. Vision 5 (1): 77–104. https://doi.org/10.1007/BF00056772.
Freeman, W., and E. Adelson. 1991. “The design and use of steerable filters.” IEEE Trans. Pattern Anal. Mach. Intell. 13 (9): 891–906. https://doi.org/10.1109/34.93808.
Ginsberg, J. 2001. “Appendix C.” In Mechanical and structural vibrations. New York: Wiley.
Greitans, M., and I. Homjakovs. 2006. “Enhanced digital signal processing of signal-dependently sampled data.” Electronic. Electr. Eng. 68 (4): 9–14.
Helfrick, M. N., C. Niezrecki, P. Avitabile, and T. Schmidt. 2011. “3D digital image correlation methods for full-field vibration measurement.” Mech. Syst. Sig. Process. 25 (3): 917–927. https://doi.org/10.1016/j.ymssp.2010.08.013.
iniLabs. 2017. “User guide: jAER.” Accessed January 5, 2017. https://inilabs.com/support/software/jaer/.
Kilpatrick, J., and V. Markov. 2008. “Matrix laser vibrometer for transient modal imaging and rapid nondestructive testing.” In Vol. 7098 of Proc., 8th Int. Conf. on Vibration Measurements by Laser Techniques: Advances and Applications. Bellingham, WA: International Society for Optics and Photonics.
Lichtsteiner, P., C. Posch, and T. Delbruck. 2008. “A 120 dB 15 μs latency asynchronous temporal contrast vision sensor.” IEEE J. Solid-State Circuits 43 (2): 566–576. https://doi.org/10.1109/JSSC.2007.914337.
Liu, S.-C., T. Delbruck, G. Indiveri, A. Whatley, and R. Douglas. 2015. Event-based neuromorphic systems. West Sussex, UK: Wiley.
Lucas, B., and T. Kanade. 1981. “An iterative image registration technique with an application to stereo vision.” In Proc., 7th Int. Joint Conf. on Artificial Intelligence (IJCAI ’81), 674–679. Vancouver, BC, Canada.
Mead, C., and M. Mahowald. 1988. “A silicon model of early visual processing.” Neural Networks 1 (1): 91–97. https://doi.org/10.1016/0893-6080(88)90024-X.
Nagarajaiah, S., and Y. Yang. 2017. “Modeling and harnessing sparse and low-rank data structure: A new paradigm for structural dynamics, identification, damage detection, and health monitoring.” Struct. Control Health Monit. 24 (1): e1851. https://doi.org/10.1002/stc.1851.
Olaszek, P. 1999. “Investigation of the dynamic characterization of bridge structures using a computer vision method.” Measurement 25 (3): 227–236. https://doi.org/10.1016/S0263-2241(99)00006-8.
Patsias, S., and W. J. Staszewskiy. 2002. “Damage detection using optical measurements and wavelets.” Struct. Health Monit. 1 (1): 5–22. https://doi.org/10.1177/147592170200100102.
Poncelet, F., G. Kerschen, J. C. Golinval, and D. Verhelst. 2007. “Output-only modal analysis using blind source separation techniques.” Mech. Syst. Sig. Process. 21 (6): 2335–2358. https://doi.org/10.1016/j.ymssp.2006.12.005.
Stanbridge, A., and D. Ewins. 1999. “Modal testing using a scanning laser Doppler vibrometer.” Mech. Syst. Sig. Process. 13 (2): 255–270. https://doi.org/10.1006/mssp.1998.1209.
Sutton, M. A., J. J. Orteu, and H. Schreier. 2009. Image correlation for shape, motion and deformation measurements: Basic concepts, theory and applications. New York: Springer Science and Business Media.
Wadhwa, N., M. Rubinstein, F. Durand, and W. Freeman. 2013. “Phase-based video motion processing.” ACM Trans. Graph. 32 (4): 1 https://doi.org/10.1145/2461912.2461966.
Wahbeh, A. M., J. Caffrey, and S. Masri. 2003. “A vision-based approach for the direct measurement of displacements in vibrating systems.” Smart Mater. Struct. 12 (5): 785–794. https://doi.org/10.1088/0964-1726/12/5/016.
Wang, W., J. Mottershead, T. Siebert, and A. Pipino. 2012. “Frequency response functions of shape features from full-field vibration measurements using digital image correlation.” Mech. Syst. Sig. Process. 28: 333–347. https://doi.org/10.1016/j.ymssp.2011.11.023.
Warren, C., C. Niezrecki, P. Avitabile, and P. Pingle. 2011. “Comparison of FRF measurements and mode shapes determined using optically image based, laser, and accelerometer measurements.” Mech. Syst. Sig. Process. 25 (6): 2191–2202. https://doi.org/10.1016/j.ymssp.2011.01.018.
Yang, Y., C. Dorn, T. Mancini, Z. Talken, G. Kenyon, C. Farrar, and D. Mascareñas. 2017a. “Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification.” Mech. Syst. Sig. Process. 85: 567–590. https://doi.org/10.1016/j.ymssp.2016.08.041.
Yang, Y., C. Dorn, T. Mancini, Z. Talken, G. Kenyon, C. Farrar, and D. Mascareñas. 2017b. “Reference-free detection of minute, non-visible, damage using full-field, high-resolution mode shapes output-only identified from digital videos structures.” Struct. Health Monit. in press.https://doi.org/10.1177/1475921717704385.
Yang, Y., and S. Nagarajaiah. 2013. “Blind modal identification of output-only structures in time-domain based on complexity pursuit.” Earthquake Eng. Struct. Dyn. 42 (13): 1885–1905. https://doi.org/10.1002/eqe.2302.
Information & Authors
Information
Published In
Journal of Engineering Mechanics
Volume 144 • Issue 7 • July 2018
Copyright
©2018 American Society of Civil Engineers.
History
Received: Jan 24, 2017
Accepted: Nov 20, 2017
Published online: May 9, 2018
Published in print: Jul 1, 2018
Discussion open until: Oct 9, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.