Technical Papers
Sep 16, 2021

Multistep Traffic Speed Prediction from Spatial–Temporal Dependencies Using Graph Neural Networks

Publication: Journal of Transportation Engineering, Part A: Systems
Volume 147, Issue 12

Abstract

Accurate traffic forecasting on citywide networks is one of the crucial urban data mining applications that accurately provide congestion warning and transportation scheduling. While previous work has made significant efforts to learn traffic temporal dynamics and spatial dependencies, two key limitations exist in current models: (1) most existing approaches solely capture spatial correlations among neighbors on predefined graph structure, and genuine relation may be missing due to the incomplete graph connections; and (2) existing methods are defective to capture the temporal trends because the recurrent and stacking structure employed in these methods suffers from the long-range temporal dependency vanquish problem. To overcome the difficulty in multistep prediction and further capture the dynamic spatial–temporal dependencies of traffic flows, we propose a new traffic speed prediction framework for multiscale graph attention networks (MS-GATNs). In particular, MS-GATNs is a hierarchically structured graph neural architecture that learns not only the local region-wise geographical dependencies but also the spatial semantics from a global perspective. Furthermore, a multiheads attention mechanism is introduced to empower our model with the capability of capturing complex nonstationary temporal dynamics. Experiments on real-world traffic data sets demonstrate that MS-GATNs outperforms the state-of-the-art baselines in long-term forecasting.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

All datasets used to support the findings of this study are available from http://pems.dot.ca.gov/ and https://www.metro.net/. The model and code supporting the findings of this study are available from the corresponding author upon reasonable request.

Acknowledgments

The paper received research funding support from the National Natural Science Foundation of China. The project is entitled “Connected Vehicle Big Data Drove Expressway Multi-Objective Coordinated Control Fusing Deep Learning and Traffic Flow Model” (Award No. 71901070).

References

Fusco, G., C. Colombaroni, and N. Isaenko. 2016. “Short-term speed predictions exploiting big data on large urban road networks.” Transp. Res. Part C: Emerging Technol. 73 (Dec): 183–201. https://doi.org/10.1016/j.trc.2016.10.019.
Guo, J., W. Huang, and B. M. Williams. 2014. “Adaptive Kalman filter approach for stochastic short-term traffic flow rate prediction and uncertainty quantification.” Transp. Res. Part C: Emerging Technol. 43 (Jun): 50–64. https://doi.org/10.1016/j.trc.2014.02.006.
Hochreiter, S., and J. Schmidhuber. 1997. “Long short-term memory.” Neural Comput. 9 (8): 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735.
Jeong, Y. S., Y. J. Byon, M. M. Castro-Neto, and S. M. Easa. 2013. “Supervised weighting-online learning algorithm for short-term traffic flow prediction.” IEEE Trans. Intell. Transp. Syst. 14 (4): 1700–1707. https://doi.org/10.1109/TITS.2013.2267735.
Kipf, T. N., and M. Welling. 2017. “Semi-supervised classification with graph convolutional networks.” In Proc., 5th Int. Conf. on Learning Representations, 1–14. La Jolla, CA: International Conference on Learning Representations.
Li, Y., R. Yu, C. Shahabi, and Y. Liu. 2018. “Diffusion convolutional recurrent neural network: Data-driven traffic forecasting.” In Proc., 6th Int. Conf. on Learning Representations. La Jolla, CA: International Conference on Learning Representations.
Liebig, T., N. Piatkowski, C. Bockermann, and K. Morik. 2017. “Dynamic route planning with real-time traffic predictions.” Inf. Syst. 64 (Mar): 258–265. https://doi.org/10.1016/j.is.2016.01.007.
Lin, Y., P. Wang, and M. Ma. 2017. “Intelligent transportation system (ITS): Concept, challenge and opportunity.” In Proc., 3rd IEEE Int. Conf. on Big Data Security on Cloud, BigDataSecurity 2017, 3rd IEEE Int. Conf. on High Performance and Smart Computing, HPSC 2017 and 2nd IEEE Int. Conf. on Intelligent Data and Security. New York: IEEE. https://doi.org/10.1109/BigDataSecurity.2017.50.
Lippi, M., M. Bertini, and P. Frasconi. 2013. “Short-term traffic flow forecasting: An experimental comparison of time-series analysis and supervised learning.” IEEE Trans. Intell. Transp. Syst. 14 (2): 871–882. https://doi.org/10.1109/TITS.2013.2247040.
Ma, X., Z. Tao, Y. Wang, H. Yu, and Y. Wang. 2015. “Long short-term memory neural network for traffic speed prediction using remote microwave sensor data.” Transp. Res. Part C: Emerging Technol. 54 (May): 187–197. https://doi.org/10.1016/j.trc.2015.03.014.
Pan, B., U. Demiryurek, and C. Shahabi. 2012. “Utilizing real-world transportation data for accurate traffic prediction.” In Proc., IEEE Int. Conf. on Data Mining (ICDM). New York: IEEE. https://doi.org/10.1109/ICDM.2012.52.
Pan, Z., Y. Liang, W. Wang, Y. Yu, Y. Zheng, and J. Zhang. 2019. “Urban traffic prediction from spatio-temporal data using deep meta learning.” In Proc., ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery. https://doi.org/10.1145/3292500.3330884.
Seo, Y., M. Defferrard, P. Vandergheynst, and X. Bresson. 2018. “Structured sequence modeling with graph convolutional recurrent networks.” In Vol. 11301 of Lecture notes in computer science, edited by L. Cheng, A. Leung, and S. Ozawa. Berlin: Springer. https://doi.org/10.1007/978-3-030-04167-0_33.
Shen, B., M. Liu, X. Liang, W. Zheng, Y. Ouyang, and K. M. Carley. 2018. “StepDeep: A novel spatial-temporal mobility event prediction framework based on deep neural network.” In Proc., ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery. https://doi.org/10.1145/3219819.3219931.
Shuman, D. I., S. K. Narang, P. Frossard, A. Ortega, and P. Vandergheynst. 2013. “The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains.” IEEE Signal Process. Mag. 30 (3): 83–98. https://doi.org/10.1109/MSP.2012.2235192.
Song, C., Y. Lin, S. Guo, and H. Wan. 2020. “Spatial-temporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting.” In Proc., AAAI Conf. on Artificial Intelligence. Palo Alto, CA: Association for the Advancement of Artificial Intelligence. https://doi.org/10.1609/aaai.v34i01.5438.
Srivastava, N., G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. 2014. “Dropout: A simple way to prevent neural networks from overfitting.” J. Mach. Learn. Res. 15 (Jan): 1929–1958.
Tang, J., F. Liu, Y. Zou, W. Zhang, and Y. Wang. 2017. “An improved fuzzy neural network for traffic speed prediction considering periodic characteristic.” IEEE Trans. Intell. Transp. Syst. 18 (9): 2340–2350. https://doi.org/10.1109/TITS.2016.2643005.
Van Lint, J. W. C., and C. P. I. J. Van Hinsbergen. 2012. “Short-term traffic and travel time prediction models.” Artif. Intell. Appl. Crit. Transp. Issues 22 (1): 22–41.
Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. 2017. “Attention is all you need.” In Advances in neural information processing systems, 5999–6009. Long Beach, CA: Neural Information Processing Systems.
Vlahogianni, E. I., M. G. Karlaftis, and J. C. Golias. 2014. “Short-term traffic forecasting: Where we are and where we’re going.” Transp. Res. Part C: Emerging Technol. 43 (Jun): 3–19. https://doi.org/10.1016/j.trc.2014.01.005.
Wang, H., and Z. Li. 2017. “Region representation learning via mobility flow.” In Proc., Int. Conf. on Information and Knowledge Management. New York: Association for Computing Machinery. https://doi.org/10.1145/3132847.3133006.
Williams, B. M., and L. A. Hoel. 2003. “Modeling and forecasting vehicular traffic flow as a seasonal ARIMA process: Theoretical basis and empirical results.” J. Transp. Eng. 129 (6): 664–672. https://doi.org/10.1061/(ASCE)0733-947X(2003)129:6(664).
Wu, Z., S. Pan, G. Long, J. Jiang, X. Chang, and C. Zhang. 2020. “Connecting the dots: Multivariate time series forecasting with graph neural networks.” In Proc., ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery. https://doi.org/10.1145/3394486.3403118.
Wu, Z., S. Pan, G. Long, J. Jiang, and C. Zhang. 2019. “Graph WaveNet for deep spatial-temporal graph modeling.” In Proc., IJCAI Int. Joint Conf. on Artificial Intelligence. Stockholm, Sweden: AAAI Press. https://doi.org/10.24963/ijcai.2019/264.
Yan, S., Y. Xiong, and D. Lin. 2018. “Spatial temporal graph convolutional networks for skeleton-based action recognition.” In Proc., 32nd AAAI Conf. on Artificial Intelligence. Palo Alto, CA: Association for the Advancement of Artificial Intelligence.
Yao, H., F. Wu, J. Ke, X. Tang, Y. Jia, S. Lu, P. Gong, Z. Li, J. Ye, and D. Chuxing. 2018. “Deep multi-view spatial-temporal network for taxi demand prediction.” In Proc., 32nd AAAI Conf. on Artificial Intelligence. Palo Alto, CA: Association for the Advancement of Artificial Intelligence.
Yu, B., H. Yin, and Z. Zhu. 2018. “Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting.” In Proc., IJCAI Int. Joint Conf. on Artificial Intelligence. Stockholm, Sweden: AAAI Press. https://doi.org/10.24963/ijcai.2018/505.
Zhang, J., Y. Zheng, and D. Qi. 2017. “Deep spatio-temporal residual networks for citywide crowd flows prediction.” In Proc., 31st AAAI Conf. on Artificial Intelligence. Palo Alto, CA: Association for the Advancement of Artificial Intelligence.
Zheng, Y., Y. Liu, J. Yuan, and X. Xie. 2011. “Urban computing with taxicabs.” In Proc., 2011 ACM Conf. on Ubiquitous Computing UbiComp’11. New York: Association for Computing Machinery. https://doi.org/10.1145/2030112.2030126.
Zivot, E., and J. Wang. 2003. “Vector autoregressive models for multivariate time series.” In Modeling financial time series with S-Plus®. New York: Springer. https://doi.org/10.1007/978-0-387-21763-5_11.

Information & Authors

Information

Published In

Go to Journal of Transportation Engineering, Part A: Systems
Journal of Transportation Engineering, Part A: Systems
Volume 147Issue 12December 2021

History

Received: Mar 24, 2021
Accepted: Jul 27, 2021
Published online: Sep 16, 2021
Published in print: Dec 1, 2021
Discussion open until: Feb 16, 2022

Permissions

Request permissions for this article.

Authors

Affiliations

Research Associate, College of Civil Engineering, Fuzhou Univ., Fuzhou 350108, China. ORCID: https://orcid.org/0000-0001-6485-6041. Email: [email protected]
Professor, College of Civil Engineering, Fuzhou Univ., Fuzhou 350108, China (corresponding author). ORCID: https://orcid.org/0000-0002-0076-8453. Email: [email protected]
Research Associate, College of Civil Engineering, Fuzhou Univ., Fuzhou 350108, China. Email: [email protected]
Master Student, College of Civil Engineering, Fuzhou Univ., Fuzhou 350108, China. ORCID: https://orcid.org/0000-0003-1964-9515. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited by

  • Internet of Vehicles Data-Oriented Arterial Travel Time Estimation Framework With Dynamic Multigraph Model, IEEE Intelligent Transportation Systems Magazine, 10.1109/MITS.2022.3225045, 15, 3, (101-116), (2023).
  • Physics-Informed Spatiotemporal Learning Framework for Urban Traffic State Estimation, Journal of Transportation Engineering, Part A: Systems, 10.1061/JTEPBS.TEENG-7545, 149, 7, (2023).
  • Personalized Modeling of Travel Behaviors and Traffic Dynamics, Journal of Transportation Engineering, Part A: Systems, 10.1061/JTEPBS.0000740, 148, 10, (2022).

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share