Computer Vision for Pipeline Monitoring Using UAVs and Deep Learning
Publication: Pipelines 2023
ABSTRACT
Pipelines play a pivotal role in the oil and gas industry as they are currently the most widely used method for conveying hydrocarbon fluids, natural gas, and petroleum products around the world. These pipelines require continuous monitoring and surveillance to ensure sustained infrastructural stability and undistorted output. Although pipeline monitoring has advanced over the years, there remains a critical need for an effective monitoring system with real-time feedback and the ability to detect minor leakages that many sensors might fail to detect. Deep learning (DL), a subset of machine learning, can be integrated with unmanned aerial vehicles to collect and analyze sensor data to solve this problem. DL using specific algorithms with pre-trained models based on historical data can detect external leakages and cracks. They can also predict likely areas of damage that could be omitted in conventional damage monitoring. Recently, there has been an increasing popularity in the use of sensor-equipped drones for monitoring pipelines in the oil and gas industry because of the numerous advantages it offers. A prominent advantage is that integrating and analyzing the data set obtained from an unmanned aerial vehicle (UAV) with DL algorithms can give real-time feedback and predict possible areas on the pipeline which show the likelihood of deterioration over time. This paper proposes a framework that integrates UAVs with DL for the monitoring of pipelines in the oil and gas industry. It is expected that the application of this framework will ensure a more efficient and proactive pipeline monitoring procedure for mitigating hazards and preventing accidents associated with oil and gas leakage or spillage.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Abdelhafidh, M., Fourati, M., Fourati, L. C., and Abidi, A. (2018). “Remote water pipeline monitoring system IoT-based architecture for new industrial era 4.0.” Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA, 2017-October, 1184–1191. https://doi.org/10.1109/AICCSA.2017.158.
Adegboye, M. A., Fung, W. K., and Karnik, A. (2019). “Recent advances in pipeline monitoring and oil leakage detection technologies: Principles and approaches.” In Sensors (Switzerland) (Vol. 19, Issue 11). MDPI AG. https://doi.org/10.3390/s19112548.
Ahmadu, J., and Egbodion, J. (2013). “Effect of Oil Spillage on Cassava Production in Niger Delta Region of Nigeria.” American Journal of Experimental Agriculture, 3(4), 914–926. www.sciencedomain.org.
Akande, S., Adetunla, A., Olanrewaju, T., and Adeoye, A. (2021). “UAV and Its Approach in Oil and Gas Pipeline Leakage Detection.” Journal of Robotics, 2021. https://doi.org/10.1155/2021/1300740.
Alwosheel, A., van Cranenburgh, S., and Chorus, C. G. (2018). “Is your dataset big enough? Sample size requirements when using artificial neural networks for discrete choice analysis.” Journal of Choice Modelling, 28, 167182.https://doi.org/10.1016/j.jocm.2018.07.002.
Amato, F., López, A., Peña-Méndez, E. M., Vaňhara, P., Hampl, A., and Havel, J. (2013). “Artificial neural networks in medical diagnosis.” Journal of Applied Biomedicine, 11(2), 47–58. https://doi.org/10.2478/v10136-012-0031-x.
Asadzadeh, S., de Oliveira, W. J., and de Souza Filho, C. R. (2022a). “UAV-based remote sensing for the petroleum industry and environmental monitoring: State-of-the-art and perspectives.” In Journal of Petroleum Science and Engineering (Vol. 208). Elsevier B.V. https://doi.org/10.1016/j.petrol.2021.109633.
Awolusi, I., Akinsemoyin, A., Chakraborty, D., and Al-Bayati, A. (2022). “Worker Safety and Health Activity Monitoring in Construction Using Unmanned Aerial Vehicles and Deep Learning.” In Construction Research Congress 2022 (pp. 463–473).
Awolusi, I. G., Momoh, A. K., and Soyingbe, A. A. (2020). “Emerging Technologies and Systems for Gas Pipeline Leak Detection.” Pipelines 2020, 64–73.
Baduge, S. K., Thilakarathna, S., Perera, J. S., Arashpour, M., Sharafi, P., Teodosio, B., Shringi, A., and Mendis, P. (2022). “Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods and applications.” Automation in Construction, 141, 104440. https://doi.org/10.1016/j.autcon.2022.104440.
Benyeogor, M. S., Olatunbosun, A., and Kumar, S. (2020). “Airborne System for Pipeline Surveillance Using an Unmanned Aerial Vehicle.” European Journal of Engineering Research and Science, 5(2), 178–182. https://doi.org/10.24018/ejers.2020.5.2.1761.
Beyer, J., Trannum, H. C., Bakke, T., Hodson, P. V., and Collier, T. K. (2016). “Environmental effects of the Deepwater Horizon oil spill: A review.” In Marine Pollution Bulletin (Vol. 110, Issue 1, pp. 28–51). Elsevier Inc. https://doi.org/10.1016/j.marpolbul.2016.06.027.
Bruederle, A., and Hodler, R. (2017). The Effect of Oil Spills on Infant Mortality: Evidence from Nigeria. http://hdl.handle.net/10419/171117.
Cai, J., Zhang, Y., Yang, L., Cai, H., and Li, S. (2020). “A context-augmented deep learning approach for worker trajectory prediction on unstructured and dynamic construction sites.” Advanced Engineering Informatics, 46. https://doi.org/10.1016/j.aei.2020.101173.
Chai, J., Zeng, H., Li, A., and Ngai, E. W. T. (2021). “Deep learning in computer vision: A critical review of emerging techniques and application scenarios.” Machine Learning with Applications, 6, 100134. https://doi.org/10.24433/CO.0411648.v1.
Chakraborty, I., and Vyvial, B. (2014). “Using deep learning to identify the severity of pipeline dents.” PPIM 2020 - 32nd Pipeline Pigging and Integrity Management Proceedings. https://doi.org/10.28999/2514-541x-2020-4-2-90-96.
Chen, C., Li, C., Reniers, G., and Yang, F. (2021). “Safety and security of oil and gas pipeline transportation: A systematic analysis of research trends and future needs using WoS.” Journal of Cleaner Production, 279. https://doi.org/10.1016/j.jclepro.2020.123583.
Da Silva, Y. M. R., Andrade, F. A. A., Sousa, L., de Castro, G. G. R., Dias, J. T., Berger, G., Lima, J., and Pinto, M. F. (2022). Computer Vision Based Path Following for Autonomous Unmanned Aerial Systems in Unburied Pipeline Onshore Inspection. Drones, 6(12). https://doi.org/10.3390/drones6120410.
Dong, S., Wang, P., and Abbas, K. (2021). A survey on deep learning and its applications. Computer Science Review, 40, 100379. https://doi.org/10.1016/j.cosrev.2021.100379.
Dumitrescu, E., Hué, S., Hurlin, C., and Tokpavi, S. (2022). Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects. European Journal of Operational Research, 297(3), 1178–1192. https://doi.org/10.1016/j.ejor.2021.06.053.
Ellenberg, A., Branco, L., Krick, A., Bartoli, I., and Kontsos, A. (2015). Use of Unmanned Aerial Vehicle for Quantitative Infrastructure Evaluation. Journal of Infrastructure Systems, 21(3). https://doi.org/10.1061/(asce)is.1943-555x.0000246.
Elyan, E., Vuttipittayamongkol, P., Johnston, P., Martin, K., McPherson, K., Jayne, C., and Sarker, M. K. (2022). “Computer vision and machine learning for medical image analysis: recent advances, challenges, and way forward.” Artificial Intelligence Surgery, 2.
Feng, X., Jiang, Y., Yang, X., Du, M., and Li, X. (2019). “Computer vision algorithms and hardware implementations: A survey.” Integration, 69, 309–320. https://doi.org/10.1016/j.vlsi.2019.07.005.
Fang, W., Ding, L., Love, P. E., Luo, H., Li, H., Pena-Mora, F., Zhong, B., and Zhou, C. (2020). “Computer vision applications in construction safety assurance.” Automation in Construction, 110, 103013.
Farrington, J. W. (2014). “Oil pollution in the marine environment II: Fates and effects of oil spills.” Environment, 56(4), 16–31. https://doi.org/10.1080/00139157.2014.922382.
Giotta, M., Trerotoli, P., Palmieri, V. O., Passerini, F., Portincasa, P., Dargenio, I., Mokhtari, J., Montagna, M. T., and De Vito, D. (2022). “Application of a Decision Tree Model to Predict the Outcome of Non-Intensive Inpatients Hospitalized for COVID-19.” International Journal of Environmental Research and Public Health, 19(20), 13016. https://doi.org/10.3390/ijerph192013016.
Gómez, C., and Green, D. R. (2017). “Small unmanned airborne systems to support oil and gas pipeline monitoring and mapping.” Arabian Journal of Geosciences, 10(9), 202. https://doi.org/10.1007/s12517-017-2989-x.
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., and Scholkopf, B. (1998). “Support vector machines.” IEEE Intelligent Systems and Their Applications, 13(4), 18–28. https://doi.org/10.1109/5254.708428.
Iqbal, T., and Ali, H. (2018). “Generative Adversarial Network for Medical Images (MI-GAN).” Journal of Medical Systems, 42(11). https://doi.org/10.1007/s10916-018-1072-9.
Kakani, V., Nguyen, V. H., Kumar, B. P., Kim, H., and Pasupuleti, V. R. (2020). “A critical review on computer vision and artificial intelligence in food industry.” Journal of Agriculture and Food Research, 2, 100033. https://doi.org/10.1016/j.jafr.2020.100033.
Karakurt, I., and Aydin, G. (2023). “Development of regression models to forecast the CO2 emissions from fossil fuels in the BRICS and MINT countries.” Energy, 263. https://doi.org/10.1016/j.energy.2022.125650.
Kench, S., and Cooper, S. J. (2021). “Generating 3D structures from a 2D slice with GAN-based dimensionality expansion.” http://arxiv.org/abs/2102.07708.
Kong, Y., and Fu, Y. (2022). “Human Action Recognition and Prediction: A Survey.” International Journal of Computer Vision, 130(5), 1366–1401. https://doi.org/10.1007/s11263-022-01594-9.
Kumar, S. S., Abraham, D. M., Jahanshahi, M. R., Iseley, T., and Starr, J. (2018). “Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks.” Automation in Construction, 91, 273–283. https://doi.org/10.1016/j.autcon.2018.03.028.
Laffon, B., Pásaro, E., and Valdiglesias, V. (2016). “Effects of exposure to oil spills on human health: Updated review.” Journal of Toxicology and Environmental Health - Part B: Critical Reviews, 19(3–4), 105–128. https://doi.org/10.1080/10937404.2016.1168730.
Mangayarkarasi, N., Raghuraman, G., and Kavitha, S. (2019). “Influence of computer vision and iot for pipeline inspection-a review.” In 2019 International Conference on Computational Intelligence in Data Science (ICCIDS) (pp. 1–6). IEEE.
Mollel, M. S., Sinde, R., Boaz, L., and Kaijage, S. (2014). An overview of pipeline leak detection and location systems. https://doi.org/10.13140/2.1.4328.8327.
Naik, B. T., Hashmi, M. F., and Bokde, N. D. (2022). “A comprehensive review of computer vision in sports: Open issues, future trends and research directions.” Applied Sciences, 12(9), 4429.
Paneru, S., and Jeelani, I. (2021). “Computer vision applications in construction: Current state, opportunities and challenges”. Automation in Construction, 132(5), 103940.
Schmidhuber, J. (2015). “Deep learning in neural networks: An overview.” Neural networks, 61, 85–117.
Jafari, R., Razvarz, S., Gegov, A., and Vatchova, B. (2020). “Deep Learning for Pipeline Damage Detection: an Overview of the Concepts and a Survey of the State-of-the-Art.” In 2020 IEEE 10th International Conference on Intelligent Systems (IS) (pp. 178–182). IEEE.
Singh, I., Singh, S. K., Kumar, S., and Aggarwal, K. (2022). “Dropout-VGG Based Convolutional Neural Network for Traffic Sign Categorization.” In M. Saraswat, H. Sharma, K. Balachandran, J. H. Kim, & J. C. Bansal (Eds.), Congress on Intelligent Systems (Vol. 114, pp. 247–261). Springer Nature Singapore. https://doi.org/10.1007/978-981-16-9416-5_18.
Sizyakin, R., Voronin, V., Gapon, N., Zelensky, A., and Pižurica, A. (2019). Automatic detection of welding defects using the convolutional neural network.
Tseng, P. Y., Lin, P. C., and Kristianto, E. (2023). “Vehicle theft detection by generative adversarial networks on driving behavior.” Engineering Applications of Artificial Intelligence, 117. https://doi.org/10.1016/j.engappai.2022.105571.
Turner, I. L., Harley, M. D., and Drummond, C. D. (2016). “UAVs for coastal surveying.” Coastal Engineering, 114, 19–24. https://doi.org/10.1016/j.coastaleng.2016.03.011.
Ugwoha, E., and Omenogor, B. E. (2017). Effect of Oil Spillage on Groundwater Quality.
Ukaegbu, U. F., Tartibu, L. K., Okwu, M. O., and Olayode, I. O. (2021). Integrating Unmanned Aerial Vehicle and Deep Learning Algorithm for Pipeline Monitoring and Inspection in the Oil and Gas Sector. 1–6. https://doi.org/10.1145/3487923.3487924.
Unlu, E., Zenou, E., Riviere, N., and Dupouy, P. E. (2019). “Deep learning-based strategies for the detection and tracking of drones using several cameras.” IPSJ Transactions on Computer Vision and Applications, 11(1). https://doi.org/10.1186/s41074-019-0059-x.
Wang, J., Fu, P., and Gao, R. X. (2019). “Machine vision intelligence for product defect inspection based on deep learning and Hough transform.” Journal of Manufacturing Systems, 51, 52–60. https://doi.org/10.1016/j.jmsy.2019.03.002.
Wang, M., and Cheng, J. C. P. (2018). “Development and improvement of deep learning based automated defect detection for sewer pipe inspection using faster R-CNN.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 10864 LNCS, 171–192.
Weinstein, B. G. (2018). “A computer vision for animal ecology.” Journal of Animal Ecology, 87(3), 533–545.
Wu, Q., Liu, Y., Li, Q., Jin, S., and Li, F. (2017). “The application of deep learning in computer vision.” In 2017 Chinese Automation Congress (CAC) (pp. 6522–6527). IEEE.
Yang, D., Cui, Y., Yu, Z., and Yuan, H. (2021). “Deep Learning Based Steel Pipe Weld Defect Detection.” Applied Artificial Intelligence, 35(15), 1237–1249. https://doi.org/10.1080/08839514.2021.1975391.
Zakikhani, K., Zayed, T., Abdrabou, B., and Senouci, A. (2020). “Modeling Failure of Oil Pipelines.” Journal of Performance of Constructed Facilities, 34(1). https://doi.org/10.1061/(asce)cf.1943-5509.0001368.
Zhang, H., Hu, X., Ma, D., Wang, R., and Xie, X. (2022). “Insufficient Data Generative Model for Pipeline Network Leak Detection Using Generative Adversarial Networks.” IEEE Transactions on Cybernetics, 52(7), 7107–7120. https://doi.org/10.1109/TCYB.2020.3035518.
Zhang, T., Shuai, J., Shuai, Y., Hua, L., Xu, K., Xie, D., and Mei, Y. (2023). “Efficient prediction method of triple failure pressure for corroded pipelines under complex loads based on a backpropagation neural network.” Reliability Engineering and System Safety, 231.
Information & Authors
Information
Published In
Pipelines 2023
Pages: 181 - 191
History
Published online: Aug 10, 2023
ASCE Technical Topics:
- Aerospace engineering
- Aircraft and spacecraft
- Business management
- Energy engineering
- Energy infrastructure
- Energy sources (by type)
- Engineering fundamentals
- Equipment and machinery
- Gas pipelines
- Industries
- Infrastructure
- Lifeline systems
- Non-renewable energy
- Oil pipelines
- Organizations
- Pipe leakage
- Pipeline management
- Pipeline systems
- Practice and Profession
- Probe instruments
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.