Comparison Metrics for Time-Histories: Application to Bridge Aerodynamics
Publication: Journal of Engineering Mechanics
Volume 146, Issue 9
Abstract
Wind effects can be critical for the design of lifelines, such as long-span bridges. The existence of a significant number of aerodynamic force models, used to assess the performance of bridges, poses an important question regarding their comparison and validation. This study utilizes a unified set of metrics for a quantitative comparison of time-histories in bridge aerodynamics with a host of characteristics. Accordingly, nine comparison metrics are included to quantify the discrepancies in local and global signal features, such as phase, time-varying frequency and magnitude content, probability density, nonstationarity, and nonlinearity. Among these, seven metrics available in the literature are introduced after recasting them for time-histories associated with bridge aerodynamics. Two additional metrics are established to overcome the shortcomings of the existing metrics. The performance of the comparison metrics is first assessed using generic signals with prescribed signal features. Subsequently, the metrics are applied to a practical example from bridge aerodynamics to quantify the discrepancies in the aerodynamic forces and response based on numerical and semianalytical aerodynamic models. In this context, it is demonstrated how a discussion based on the set of comparison metrics presented in this study can aid a model evaluation by offering deeper insight. The outcome of the study is intended to provide a framework for quantitative comparison and validation of aerodynamic models based on the underlying physics of fluid-structure interaction. Immediate further applications are expected for the comparison of time-histories that are simulated by data-driven approaches.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are available in a repository online in accordance with funder data retention policies. The Matlab code for the comparison metrics, including partial results, is available online: https://github.com/IgorKavrakov/CompMet. Some data, models, or code generated or used during the study are proprietary or confidential in nature and may only be provided with restrictions.
Acknowledgments
The first and third author gratefully acknowledge the support by the German Research Foundation (DFG) (Project Nos. 43475018 and 329120866) throughout the first author’s studies and research stay at the Department of Civil and Environmental Engineering and Earth Sciences at the University of Notre Dame, US. The second author acknowledges the support provided in part by NSF Grant No. 1562244.
References
Abbas, T., I. Kavrakov, and G. Morgenthal. 2017. “Methods for flutter stability analysis of long-span bridges: A review.” Proc. Inst. Civ. Eng.—Bridge Eng. 170 (Dec): 271–310. https://doi.org/10.1680/jbren.15.00039.
Akbari, M. H., and S. J. Price. 2003. “Simulation of dynamic stall for a NACA 0012 airfoil using a vortex method.” J. Fluids Struct. 17 (6): 855–874. https://doi.org/10.1016/S0889-9746(03)00018-5.
Bliemel, F. 1973. “Theil’s forecast accuracy coefficient: A clarification.” J. Mark. Res. 10 (4): 444–446. https://doi.org/10.1177/002224377301000413.
Borgant, P., P. Flandrin, P. Hoene, C. Richard, and J. Xiao. 2010. “Testing stationarity with surrogates: A time-frequency approach.” IEEE Trans. Signal Process. 58 (7): 3459–3470. https://doi.org/10.1109/TSP.2010.2043971.
Botev, Z., J. Grotowski, and D. Kroese. 2010. “Kernel density estimation via diffusion.” Ann. Stat. 38 (5): 2916–2957. https://doi.org/10.1214/10-AOS799.
Caracoglia, L., and N. P. Jones. 2003. “Time domain vs. frequency domain characterization of aeroelastic forces for bridge deck sections.” J. Wind. Eng. Ind. Aerodyn. 91 (3): 371–402. https://doi.org/10.1016/S0167-6105(02)00399-9.
Carassale, L., T. Wu, and A. Kareem. 2014. “Nonlinear aerodynamics and aeroelastic analysis of bridges: Frequency domain approach.” J. Eng. Mech. 140 (8): 04014051. https://doi.org/10.1061/(ASCE)EM.1943-7889.0000737.
Chen, X., and A. Kareem. 2001. “Aeroelastic analysis of bridges under multicorrelated winds: Integrated state-space approach.” J. Eng. Mech. 127 (11): 1124–1134. https://doi.org/10.1061/(ASCE)0733-9399(2001)127:11(1124).
Chen, X., and A. Kareem. 2002. “Advances in modeling of aerodynamic forces on bridge decks.” J. Eng. Mech. 128 (11): 1193–1205. https://doi.org/10.1061/(ASCE)0733-9399(2002)128:11(1193).
Chen, X., and A. Kareem. 2003. “Aeroelastic analysis of bridges: Effects of turbulence and aerodynamic nonlinearities.” J. Eng. Mech. 129 (8): 885–895. https://doi.org/10.1061/(ASCE)0733-9399(2003)129:8(885).
Chen, X., and A. Kareem. 2006. “Revisiting multimode coupled bridge flutter: Some new insights.” J. Eng. Mech. 132 (10): 1115–1123. https://doi.org/10.1061/(ASCE)0733-9399(2006)132:10(1115).
Cottet, G., and P. Koumoutsakos. 2000. Vortex methods: Theory and practice. Cambridge, UK: Cambridge University Press.
Cvetkovic, D., E. D. Übely, and I. Cosic. 2008. “Wavelet transform feature extraction from human PPG, ECG, and EEG signal responses to ELF PEMF exposures: A pilot study.” Dig. Signal Process. 18 (5): 861–874. https://doi.org/10.1016/j.dsp.2007.05.009.
Diana, G., D. Rocchi, and T. Argentini. 2013. “An experimental validation of band superposition model of the aerodynamic forces acting on a multi-box deck sections.” J. Wind Eng. Ind. Aerodyn. 113 (Feb): 40–58. https://doi.org/10.1016/j.jweia.2012.12.005.
Diana, G., D. Rocchi, T. Argentini, and S. Muggiasca. 2010. “Aerodynamic instability of a bridge deck section model: Linear and nonlinear approach to force modeling.” J. Wind Eng. Ind. Aerodyn. 98 (6–7): 363–374. https://doi.org/10.1016/j.jweia.2010.01.003.
Diana, G., et al. 2019a. “IABSE Task Group 3.1 benchmark results. Part 1: Numerical analysis of a two-degree-of-freedom bridge deck section based on analytical aerodynamics.” Struct. Eng. Int. 1–10. https://doi.org/10.1080/10168664.2019.1639480.
Diana, G., et al. 2019b. “IABSE Task Group 3.1 benchmark results. Part 2: Numerical analysis of a three-degree-of-freedom bridge deck section based on experimental aerodynamics.” Struct. Eng. Int. https://doi.org/10.1080/10168664.2019.1661331.
Eldrege, J. D. 2007. “Numerical simulation of the fluid dynamics of 2D rigid body motion with the vortex particle method.” J. Comput. Phys. 221 (2): 626–648. https://doi.org/10.1016/j.jcp.2006.06.038.
Elgar, S., and G. Sebert. 1989. “Statistics of bicoherence and biphase.” J. Geophys. Res. 94 (C8): 993–998. https://doi.org/10.1029/JC094iC08p10993.
Fackrell, J. W. A., and S. McLaughlin. 1995. “Quadratic phase coupling detection using higher order statistics.” In IEE Colloquium on Higher Order Statistics in Signal Processing: Are They of Any Use? 9/1–9/8. London: The Institute of Engineering and Technology. https://doi.org/10.1049/ic:19950736.
Fackrell, J. W. A., P. R. White, J. K. Hammond, and R. J. Pinnington. 1995. “The interpretation of the bispectra of vibration signals-I. Theory.” Mech. Syst. Signal Process. 9 (3): 257–266. https://doi.org/10.1006/mssp.1995.0021.
Fung, Y. 1993. An introduction to the theory of aeroelasticity. New York: Dover Publications.
Ge, Y., and H. F. Xiang. 2008. “Computational models and methods for aerodynamic flutter of long-span bridges.” J. Wind Eng. Ind. Aerodyn. 96 (10–11): 1912–1924. https://doi.org/10.1016/j.jweia.2008.02.017.
Grossmann, A., and J. Morlet. 1984. “Decomposition of hardy functions into square integrable wavelets of constant shape.” SIAM J. Math. Anal. 15 (4): 723–736. https://doi.org/10.1137/0515056.
Gurley, K., and A. Kareem. 1997. “Analysis interpretation modeling and simulation of unsteady wind and pressure data.” J. Wind Eng. Ind. Aerodyn. 69 (Jul): 657–669. https://doi.org/10.1016/S0167-6105(97)00195-5.
Gurley, K., T. Kijewski, and A. Kareem. 2003. “First- and higher-order correlation detection using wavelet transforms.” J. Eng. Mech. 129 (2): 188–201. https://doi.org/10.1061/(ASCE)0733-9399(2003)129:2(188).
Hora, J., and P. Campos. 2015. “A review of performance criteria to validate simulation models.” Expert Syst. 32 (5): 578–595. https://doi.org/10.1111/exsy.12111.
Huang, L., Y.-L. Xu, and H. Liao. 2014. “Nonlinear aerodynamic forces on thin flat plate: Numerical study.” J. Fluids. Struct. 44 (Jan): 182–194. https://doi.org/10.1016/j.jfluidstructs.2013.10.009.
Jamšek, J., A. Stefanovska, and P. V. E. McClintock. 2007. “Wavelet bispectral analysis for the study of interactions among oscillators whose basic frequencies are significantly time variable.” Phys. Rev. E. 76 (4): 046221. https://doi.org/10.1103/PhysRevE.76.046221.
Jiang, X., and S. Mahadevan. 2011. “Wavelet spectrum analysis approach to model validation of dynamic systems.” Mech. Syst. Signal Process. 25 (2): 575–590. https://doi.org/10.1016/j.ymssp.2010.05.012.
Kareem, A., and T. Kijewski. 2002. “Time-frequency analysis of wind effects on structures.” J. Wind Eng. Ind. Aerody. 90 (12–15): 1435–1452. https://doi.org/10.1016/S0167-6105(02)00263-5.
Kareem, A., and T. Wu. 2013. “Wind-induced effects on bluff bodies in turbulent flows: Nonstationary, non-Gaussian and nonlinear features.” J. Wind Eng. Ind. Aerody. 122 (Nov): 21–37. https://doi.org/10.1016/j.jweia.2013.06.002.
Kavrakov, I., D. Legatiuk, K. Gürlebeck, and G. Morgenthal. 2019. “A categorical perspective towards aerodynamic models for aeroelastic analyses of bridge decks.” R. Soc. Open Sci. 6 (3): 181848. https://doi.org/10.1098/rsos.181848.
Kavrakov, I., and G. Morgenthal. 2017. “A comparative assessment of aerodynamic models for buffeting and flutter of long-span bridges.” Engineering. 3 (6): 823–838. https://doi.org/10.1016/j.eng.2017.11.008.
Kavrakov, I., and G. Morgenthal. 2018a. “Aeroelastic analyses of bridges using a pseudo-3D vortex method and velocity-based synthetic turbulence generation.” Eng. Struct. 176 (Dec): 825–839. https://doi.org/10.1016/j.engstruct.2018.08.093.
Kavrakov, I., and G. Morgenthal. 2018b. “A synergistic study of a CFD and semi-analytical models for aeroelastic analysis of bridges in turbulent wind conditions.” J. Fluids Struct. 82 (Oct): 59–85. https://doi.org/10.1016/j.jfluidstructs.2018.06.013.
Kijewski, T., and A. Kareem. 2003. “Wavelet transforms for system identification in civil engineering.” Comput.-Aided Civ. Infrastrcut. Eng. 18 (5): 339–355. https://doi.org/10.1111/1467-8667.t01-1-00312.
Kim, T., E. J. Powers, W. M. Grady, and A. Arapostathis. 2007. “A novel QPC detector for the health monitoring of rotating machines.” In Proc., IEEE Instrumentation Measurement Technology Conf., 1–6. New York: IEEE.
Kim, Y. C., and E. J. Powers. 1979. “Digital bispectral analysis and its applications to nonlinear wave interactions.” IEEE Trans. Plasma Sci. 7 (2): 120–131. https://doi.org/10.1109/TPS.1979.4317207.
Kovacs, I., H. S. Svensson, and E. Jordet. 1992. “Analytical aerodynamic investigation of cable-stayed Helgeland bridge.” J. Struct. Eng. 118 (1): 147–168. https://doi.org/10.1061/(ASCE)0733-9445(1992)118:1(147).
Kristeková, M., J. Kristek, and P. Moczo. 2009. “Time-frequency misfit and goodness-of-fit criteria for quantitative comparison of time signals.” Geophys. J. Int. 178 (2): 813–825. https://doi.org/10.1111/j.1365-246X.2009.04177.x.
Lancester, G., D. Iatsenko, A. Pidde, V. Ticcinelli, and A. Stefanovska. 2018. “Surrogate data for hypothesis testing of physical systems.” Phys. Rep. 748 (Jul): 1–60. https://doi.org/10.1016/j.physrep.2018.06.001.
Larsen, A., and J. H. Walther. 1997. “Aeroelastic analysis of bridge girder sections based on discrete vortex simulations.” J. Wind Eng. Ind. Aerodyn. 67 (Apr): 253–265. https://doi.org/10.1016/S0167-6105(97)00077-9.
Li, X., L. Duan, J. V. Logan, and J. W. Sleigh. 2009. “The comodulation measure of neuronal oscillations with general harmonic wavelet bicoherence and application to sleep analysis.” NeuroImage. 48 (3): 501-514. https://doi.org/10.1016/j.neuroimage.2009.07.008.
Li, Y., and A. Kareem. 1990. “Stochastic response of tension leg platforms to wind and wave fields.” J. Wind Eng. Ind. Aerodyn. 36 (Jan): 915–926. https://doi.org/10.1016/0167-6105(90)90088-T.
McCullough, M. 2016. “Data-driven models: From data to knowledge for extreme events.” Ph.D. thesis, Dept. of Civil and Environmental Engineering and Earth Sciences, Univ. of Notre Dame.
McCullough, M., and A. Kareem. 2013. “Testing stationarity with wavelet-based surrogates.” J. Eng. Mech. 139 (2): 200–209. https://doi.org/10.1061/(ASCE)EM.1943-7889.0000484.
Morgenthal, G., A. Corriols, and B. Bendig. 2014. “A GPU-accelerated pseudo-3D vortex method for aerodynamic analysis.” J. Wind Eng. Ind. Aerodyn. 125 (Feb): 69–80. https://doi.org/10.1016/j.jweia.2013.12.002.
Morgenthal, G., and F. McRobie. 2002. “A comparative study of numerical methods for fluid-structure interaction analysis in long-span bridge design.” Wind Struct. 5 (2): 101–114. https://doi.org/10.12989/was.2002.5.2_3_4.101.
Morgenthal, G., and J. Walther. 2007. “An immersed interface method for the vortex-in-cell algorithm.” Comput. Struct. 85 (11): 712–726. https://doi.org/10.1016/j.compstruc.2007.01.020.
Müller, M. 2007. Information retrieval for music and motion. Berlin: Springer.
Nielsen, F., and S. Boltz. 2011. “The Burbea-Rao and Bhattacharyya centroids.” IEEE Trans. Inf. Theory. 57 (8): 5455–5466. https://doi.org/10.1109/TIT.2011.2159046.
Nikitas, C., and A. P. Petropulu. 1993. Higher-order spectra analysis: A non-linear signal processing framework. Upper Saddle River, NJ: Prentice Hall.
Øiseth, O., A. Rönnquist, and R. Sigbjörnsson. 2011. “Time domain modeling of self-excited aerodynamic forces for cable supported bridges: A comparative study.” Comput. Struct. 89 (13): 1306–1322. https://doi.org/10.1016/j.compstruc.2011.03.017.
Pardo, L. 2006. Statistical inference based on divergence measures. Boca Raton, FL: CRC Press.
Petrini, F., F. Giuliano, and F. Bontempi. 2007. “Comparison of time domain techniques for evaluation of the response of the stability in long span suspension bridges.” Comput. Struct. 85 (11): 1032–1048. https://doi.org/10.1016/j.compstruc.2006.11.015.
Richard, C., A. Ferrari, H. Amoud, P. Honeine, P. Flandrin, and P. Borgnat. 2010. “Statistical hypothesis testing with time-frequency surrogates to check signal stationarity.” In Proc., IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, 3666–3669. New York: IEEE.
Sarin, H., M. Kokkolaras, G. Hulbert, P. Papalambros, S. Barbat, and R. J. Yang. 2010. “Comparing time histories for validation of simulation models: Error measures and metrics.” J. Dyn. Syst. Meas. Contr. 132 (6): 061401. https://doi.org/10.1115/1.4002478.
Scanlan, R. H. 1978. “The action of flexible bridges under wind, I: Flutter theory.” J. Sound. Vib. 60 (2): 187–199. https://doi.org/10.1016/S0022-460X(78)80028-5.
Scanlan, R. H. 2001. “Reexamination of sectional aerodynamic force functions for bridges.” J. Wind. Eng. Ind. Aerodyn. 89 (14): 1257–1266. https://doi.org/10.1016/S0167-6105(01)00141-6.
Scanlan, R. H., J. G. Bélveau, and K. S. Budlong. 1974. “Indicial aerodynamic functions for bridge decks.” J. Eng. Mech. Div. 100 (Aug): 657–673.
Scully, C. G., N. Mitrou, B. Braam, W. A. Cupples, and K. H. Cho. 2017. “Detecting interactions between renal autoregulation mechanisms in time and space.” IEEE Trans. Biomed. Eng. 64 (3): 690–698. https://doi.org/10.1109/TBME.2016.2569453.
Shamma, J. S., and R. Zhao. 1993. “Fading-memory feedback systems and robust stability.” Automatica. 29 (1): 191–200. https://doi.org/10.1016/0005-1098(93)90182-S.
Sprague, M. A., and T. Geers. 2004. “A spectra-element method for modelling cavitation in transient fluid-structure interaction.” Int. J. Numer. Meth. Eng. 60 (15): 2467–2499. https://doi.org/10.1002/nme.1054.
Teferra, K., M. D. Schields, A. Hapij, and R. P. Daddazio. 2014. “Mapping model validation metrics to subject matter expert scores for model adequacy assessment.” Reliab. Eng. Syst. Safe. 132 (Dec): 9–19. https://doi.org/10.1016/j.ress.2014.07.010.
van Milligen, B. P., B. Carreras, and L. Garcia. 1995. “Wavelet bicoherence: A new turbulence analysis tool.” Phys. Plasmas. 2 (8): 3017–3032. https://doi.org/10.1063/1.871199.
Wang, L., M. McCullough, and A. Kareem. 2013. “A data-driven approach for simulation of full-scale downburst wind speeds.” J. Wind Eng. Ind. Aerodyn. 123 (Dec): 171–190. https://doi.org/10.1016/j.jweia.2013.08.010.
Willmott, C. J., S. G. Ackleson, R. E. Davis, J. J. Feddema, K. M. Klink, D. R. Legates, J. O’Donnel, and C. Rowe. 1985. “Statistics for the evaluation of comparison of models.” J. Geophys. Res. 90 (5): 8995–9905. https://doi.org/10.1029/JC090iC05p08995.
Wu, T., and A. Kareem. 2011. “Modeling hysteretic nonlinear behavior of bridge aerodynamics via cellular automata nested neural network.” J. Wind Eng. Ind. Aerodyn. 99 (4): 378–388. https://doi.org/10.1016/j.jweia.2010.12.011.
Wu, T., and A. Kareem. 2013a. “Aerodynamics and aeroelasticity of cable-supported bridges: Identification of nonlinear features.” J. Eng. Mech. 139 (12): 1886–1893. https://doi.org/10.1061/(ASCE)EM.1943-7889.0000615.
Wu, T., and A. Kareem. 2013b. “Bridge aerodynamics and aeroelasticity: A comparison of modeling schemes.” J. Fluids Struct. 43 (Nov): 347–370. https://doi.org/10.1016/j.jfluidstructs.2013.09.015.
Wu, T., and A. Kareem. 2013c. “A nonlinear convolution scheme to simulate bridge aerodynamics.” Comput. Struct. 128 (Nov): 259–271. https://doi.org/10.1016/j.compstruc.2013.06.004.
Wu, T., and A. Kareem. 2015. “A nonlinear analysis framework for bluff-body aerodynamics: A Volterra representation of the solution of Navier-Stokes equations.” J. Fluids Struct. 54 (Apr): 479–502. https://doi.org/10.1016/j.jfluidstructs.2014.12.005.
Zhang, Z., X. Zhang, Y. Yang, and Y. Ge. 2017. “Nonlinear aerodynamic and energy input properties of a twin-box girder deck section.” J. Fluids Struct. 74 (Oct): 413–426. https://doi.org/10.1016/j.jfluidstructs.2017.06.016.
Information & Authors
Information
Published In
Journal of Engineering Mechanics
Volume 146 • Issue 9 • September 2020
Copyright
©2020 American Society of Civil Engineers.
History
Received: Feb 6, 2019
Accepted: Mar 9, 2020
Published online: Jun 23, 2020
Published in print: Sep 1, 2020
Discussion open until: Nov 23, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.