Automated Assessment of Public Transit Bus Stops Using Computer Vision Methods
Publication: Journal of Computing in Civil Engineering
Volume 37, Issue 5
Abstract
Transit bus systems are an essential part of public transportation systems and they improve the accessibility of the communities and economical activities. On-street assets, namely bus stops, are key elements of public bus transit systems, but their condition assessment mostly depends on manual efforts that are labor-intensive and expensive. This research proposes a novel system for detection and assessment of the public transit bus stops using captured videos by on-board cameras. This system utilizes deep convolutional neural networks (DCNNs) to detect bus stop assets and semantically segment pixels in the corresponding video frames. Then, the results of these two modules are further processed to assess the connectivity of the bus stop mobility pads and accessibility level of the bus stops on snowy days. The experimental results showed promising performance of the proposed methods, which have potentials for practical applications.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are proprietary or confidential in nature and may only be provided with restrictions. The training data are restricted due to the privacy regulation of research partners.
Acknowledgments
This work was financially supported by the Natural Sciences and Engineering Research Council of Canada’s Alliance program, City of Thunder Bay, and Consat Canada Inc. We would like to thank Brooklin Caren from Thunder Bay Transit for the constructive feedback on this work.
References
Alizadeh, B., D. Li, J. Hillin, M. A. Meyer, C. M. Thompson, Z. Zhang, and A. H. Behzadan. 2022. “Human-centered flood mapping and intelligent routing through augmenting flood gauge data with crowdsourced street photos.” Adv. Eng. Inf. 54 (Oct): 101730. https://doi.org/10.1016/j.aei.2022.101730.
AODA (Accessibility for Ontarians with Disabilities Act). 2018. “Ontario public transit: Accessible for everyone.” Accessed February 7, 2023. https://aoda.ca/ontario-public-transit/.
Balali, V., and M. Golparvar-Fard. 2015. “Segmentation and recognition of roadway assets from car-mounted camera video streams using a scalable non-parametric image parsing method.” Autom. Constr. 49 (Jan): 27–39. https://doi.org/10.1016/j.autcon.2014.09.007.
Bartholomew, K., J. Y. Kim, A. Adkins, S. Jensen, D. Chandrasehkar, and R. Ewing. 2020. The role of bus stop features in facilitating accessibility. Taylorsville, UT: DOT.
Benenson, I., E. Ben-Elia, Y. Rofé, and D. Geyzersky. 2017. “The benefits of a high-resolution analysis of transit accessibility.” Int. J. Geogr. Inf. Sci. 31 (2): 213–236. https://doi.org/10.1080/13658816.2016.1191637.
Bochkovskiy, A., C. Y. Wang, and H. Y. M. Liao. 2020. “YOLOv4: Optimal speed and accuracy of object detection.” Preprint, submitted April 23, 2020. http://arxiv.org/abs/2004.10934.
Chen, F. C., A. Subedi, M. R. Jahanshahi, D. R. Johnson, and E. J. Delp. 2022. “Deep learning–based building attribute estimation from Google Street View images for flood risk assessment using feature fusion and task relation encoding.” J. Comput. Civ. Eng. 36 (6): 04022031. https://doi.org/10.1061/(ASCE)CP.1943-5487.0001025.
City of Hamilton. 2022. “Transit bus stop accessibility criteria & guidelines.” Accessed February 11, 2023. https://www.hamilton.ca/build-invest-grow/planning-development/planning-policies-guidelines/transit-bus-stop-accessibility.
City of Toronto. 2023. “Salting & plowing roads.” Accessed February 12, 2023. https://www.toronto.ca/services-payments/streets-parking-transportation/road-maintenance/winter-maintenance/levels-of-snow-clearing-service/.
Corazza, M. V., and N. Favaretto. 2019. “A methodology to evaluate accessibility to bus stops as a contribution to improve sustainability in urban mobility.” Sustainability 11 (3): 803. https://doi.org/10.3390/su11030803.
Fayyaz, S. K., X. C. Liu, and R. J. Porter. 2017. “Dynamic transit accessibility and transit gap causality analysis.” J. Transp. Geogr. 59 (Mar): 27–39. https://doi.org/10.1016/j.jtrangeo.2017.01.006.
Fry, D., S. J. Mooney, D. A. Rodríguez, W. T. Caiaffa, and G. S. Lovasi. 2020. “Assessing Google Street View image availability in Latin American cities.” J. Urban Health 97 (4): 552–560. https://doi.org/10.1007/s11524-019-00408-7.
Halabya, A., and K. El-Rayes. 2022. “Automated framework for extracting sidewalk dimensions from images using deep learning.” Can. J. Civ. Eng. 49 (6): 1049–1058. https://doi.org/10.1139/cjce-2020-0525.
He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep residual learning for image recognition.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 770–778. New York: IEEE.
Karaaslan, E., U. Bagci, and F. N. Catbas. 2021. “Attention-guided analysis of infrastructure damage with semi-supervised deep learning.” Autom. Constr. 125 (May): 103634. https://doi.org/10.1016/j.autcon.2021.103634.
Kargah-Ostadi, N., A. Waqar, and A. Hanif. 2020. “Automated real-time roadway asset inventory using artificial intelligence.” Transp. Res. Rec. 2674 (11): 220–234. https://doi.org/10.1177/0361198120944926.
Kazhdan, M., and H. Hoppe. 2013. “Screened Poisson surface reconstruction.” ACM Trans. Graph. 32 (3): 1–13. https://doi.org/10.1145/2487228.2487237.
Kim, H., and Y. Ham. 2019. “Participatory sensing-based geospatial localization of distant objects for disaster preparedness in urban built environments.” Autom. Constr. 107 (Aug): 102960. https://doi.org/10.1016/j.autcon.2019.102960.
Kim, J., M. Kamari, S. Lee, and Y. Ham. 2021. “Large-scale visual data–driven probabilistic risk assessment of utility poles regarding the vulnerability of power distribution infrastructure systems.” J. Constr. Eng. Manage. 147 (10): 04021121. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002153.
Lakhotia, S., K. R. Rao, and G. Tiwari. 2019. “Accessibility of bus stops for pedestrians in Delhi.” J. Urban Plann. Dev. 145 (4): 05019015. https://doi.org/10.1061/(ASCE)UP.1943-5444.0000525.
Moran, M. E. 2022. “Are shelters in place? Mapping the distribution of transit amenities via a bus-stop census of San Francisco.” J. Public Transp. 24 (Feb): 100023. https://doi.org/10.1016/j.jpubtr.2022.100023.
Shameli, S. M., and E. Rezazadeh Azar. 2022. “Computer vision-based generating and updating of the public transit bus stop inventories.” J. Infrastruct. Intell. Resilience 1 (2): 100016. https://doi.org/10.1016/j.iintel.2022.100016.
Spencer, B. F., Jr., V. Hoskere, and Y. Narazaki. 2019. “Advances in computer vision-based civil infrastructure inspection and monitoring.” Engineering 5 (2): 199–222. https://doi.org/10.1016/j.eng.2018.11.030.
Sprague, W., and E. Rezazadeh Azar. 2022. “Integrating acceleration signal processing and image segmentation for condition assessment of asphalt roads.” Can. J. Civ. Eng. 49 (6): 1095–1107. https://doi.org/10.1139/cjce-2021-0116.
Strain, T., R. Eddie Wilson, and R. Littleworth. 2020. “Computer vision for rapid updating of the highway asset inventory.” Transp. Res. Rec. 2674 (9): 245–255. https://doi.org/10.1177/0361198120928348.
Strain, T., R. E. Wilson, and R. Littleworth. 2022. “Patrol regimes for traffic officers in transportation asset monitoring.” Transp. Res. Rec. 2677 (1): 1039–1058. https://doi.org/10.1177/03611981221103243.
Trpković, A., M. Šelmić, and S. Jevremović. 2021. “Model for the identification and classification of partially damaged and vandalized traffic signs.” KSCE J. Civ. Eng. 25 (10): 3953–3965. https://doi.org/10.1007/s12205-021-1796-9.
Weld, G., E. Jang, A. Li, A. Zeng, K. Heimerl, and J. E. Froehlich. 2019. “Deep learning for automatically detecting sidewalk accessibility problems using streetscape imagery.” In Proc., 21st Int. ACM SIGACCESS Conf. on Computers and Accessibility, 196–209. New York: Association for Computing Machinery.
Zhang, W., C. Witharana, W. Li, C. Zhang, X. Li, and J. Parent. 2018. “Using deep learning to identify utility poles with crossarms and estimate their locations from Google Street View images.” Sensors 18 (8): 2484. https://doi.org/10.3390/s18082484.
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 37 • Issue 5 • September 2023
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Dec 8, 2022
Accepted: Apr 3, 2023
Published online: Jun 23, 2023
Published in print: Sep 1, 2023
Discussion open until: Nov 23, 2023
ASCE Technical Topics:
- Asset management
- Automated transit systems
- Bus stops
- Buses
- Business management
- Computer vision and image processing
- Engineering fundamentals
- Financial management
- Highway transportation
- Infrastructure
- Methodology (by type)
- Practice and Profession
- Public transportation
- Terminal facilities
- Transportation engineering
- Transportation management
- Vehicles
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.