A Convolutional Autoencoder Framework for Probabilistic Anomaly Detection on Infrastructure Systems
Publication: Computing in Civil Engineering 2023
ABSTRACT
Data-driven autonomous anomaly detection, empowered by advanced sensing and machine learning techniques, has the potential to significantly reduce costs associated with infrastructure maintenance. In this paper, we studied the impact of probabilistic anomaly detection in the context of a proposed deep learning-empowered framework for multivariate time series anomaly detection. In this framework, two-dimensional convolutional autoencoders are utilized to learn the patterns of normal data and detect unseen anomalous data points that fail to be reconstructed by the well-trained autoencoders. Kernel density estimation was utilized to generate a probability distribution function based on raw window-based anomaly predictions. Our assessments showed promising performance in a real-world case study of Class I railroad track anomaly detection. We conducted a comparative study that proved our hypothesis that probabilistic anomaly detection outperforms the deterministic approach of anomaly detection using direct autoencoder output. Furthermore, the impact of multivariate time series data processing methods, autoencoder architecture, and anomaly score thresholds was also investigated.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Chow, J. K., Z. Su, J. Wu, P. S. Tan, X. Mao, and Y.-H. Wang. 2020. 'Anomaly detection of defects on concrete structures with the convolutional autoencoder', Advanced Engineering Informatics, 45: 101105.
Gondara, L. 2016. “Medical image denoising using convolutional denoising autoencoders.” In 2016 IEEE 16th international conference on data mining workshops (ICDMW), 241–46. IEEE.
Gu, Y., and F. Jazizadeh. 2022. 'DEGAN: Time Series Anomaly Detection using Generative Adversarial Network Discriminators and Density Estimation', arXiv preprint arXiv:2210.02449.
Jiang, J., G. Han, L. Shu, and M. Guizani. 2020. 'Outlier detection approaches based on machine learning in the internet-of-things', IEEE Wireless Communications, 27: 53–59.
Li, D., D. Chen, B. Jin, L. Shi, J. Goh, and S.-K. Ng. 2019. MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks. in (Springer International Publishing).
Mao, J., H. Wang, and B. F. Spencer Jr. 2021. 'Toward data anomaly detection for automated structural health monitoring: Exploiting generative adversarial nets and autoencoders', Structural Health Monitoring, 20: 1609–26.
Shu, X., T. Bao, Y. Zhou, R. Xu, Y. Li, and K. Zhang. 2023. 'Unsupervised dam anomaly detection with spatial–temporal variational autoencoder', Structural Health Monitoring, 22: 39–55.
Wang, Y., H. Yao, and S. Zhao. 2016. 'Auto-encoder based dimensionality reduction', Neurocomputing, 184: 232–42.
Zhang, Y., Z. Gan, K. Fan, Z. Chen, R. Henao, D. Shen, and L. Carin. 2017. “Adversarial feature matching for text generation.” In International Conference on Machine Learning, 4006-15. PMLR.
Zonta, T., C. André Da Costa, R. da Rosa Righi, M. Jose de Lima, E. Silveira da Trindade, and G. Pyng Li. 2020. 'Predictive maintenance in the Industry 4.0: A systematic literature review', Computers & Industrial Engineering, 150: 106889.
Information & Authors
Information
Published In
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Architectural engineering
- Artificial intelligence and machine learning
- Building management
- Case studies
- Comparative studies
- Computer programming
- Computing in civil engineering
- Engineering fundamentals
- Infrastructure
- Maintenance and operation
- Mathematics
- Measurement (by type)
- Methodology (by type)
- Probability
- Research methods (by type)
- Sensors and sensing
- Statistics
- Time series analysis
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.