Chapter
Jan 25, 2024

Deep Reinforcement Learning for Optimal Planning of Fast Electric Vehicle Charging Stations at a Large Scale

Publication: Computing in Civil Engineering 2023

ABSTRACT

Electric vehicles (EVs) have been widely adopted with the expectation of reducing CO2 emissions. However, the lack of public fast charging stations has hindered the growth of EVs. Despite extensive research on optimal installation of EV charging stations (EVCS), a decision model for a large scale and diverse spatial conditions has been still lacking. This research intends to explore a deep reinforcement learning model using deep Q-network (DQN) algorithms and test the model for optimal planning of fast EVCS at a large scale. The DQN model considers geographic (e.g., building footprints, street network), economic (e.g., capacity of charging station), and environmental (e.g., solar energy) perspectives. The learning model identifies the energy balance between electricity generation and consumption and investigates spatial patterns nearby potential charging stations. This study can aid in decision-making for suitable EVCS sites with advancing the microgrid approach-based infrastructure systems, ultimately enhancing urban sustainability considering vehicle-to-building integration.

Get full access to this article

View all available purchase options and get full access to this chapter.

REFERENCES

Abdullah, H. M., Gastli, A., Ben-Brahim, L., and Mohammed, S. O. (2022). “Planning and optimizing electric-vehicle charging infrastructure through system dynamics.” IEEE Access, 10. 17495–17514.
AECOM. (2019). City of Chicago greenhouse gas inventory report, City of Chicago.
Arias, A., Sanchez, J., and Granada, M. (2018). “Integrated planning of electric vehicles routing and charging stations location considering transportation networks and power distribution systems. International Journal of Industrial Engineering Computations, 9(4). 535–550.
Chicago Data Portal. Average daily traffic counts – Map, City of Chicago.
Chicago Metropolitan Agency for Planning. Land Use Data. <https://cmap.illinois.gov/data/land-use>(Mar 7 2023).
EIA (US Energy Information Administration). (2022). “Energy and the environment explained Where greenhouse gases come from” EIA, https://eia.gov/energyexplained/energy-and-the-environment/where-greenhouse-gases-come-from.php (Mar 3, 2023).
Guo, S., and Zhao, H. (2015). “Optimal site selection of electric vehicle charging station by using fuzzy TOPSIS based on sustainability perspective.” Applied Energy, 158. 390–402.
Heo, J., and Chang, S. (2022b). “Economic and environmental impacts of installation of fast charging on existing buildings for V2B uses.” Energy, The 14th International Conference on Applied Energy, 29: 2965. Bochum, Germany (Virtual).
Ilsos.gov. (2023). Illinois secretary of state active registration counts – Cook county, Office of the Illinois secretary of state.
Kong, W., Luo, Y., Feng, G., Li, K., and Peng, H. (2019). “Optimal location planning method of fast charging station for electric vehicles considering operators, drivers, vehicles, traffic flow and power grid.” Energy, 186, 115826.
Pan, A., Zhao, T., Yu, H., and Zhang, Y. (2019). “Deploying public charging stations for elctric taxis: A charging demand simulation embedded approach.” IEEE Access, 7.17412–17424.
Sun, Z., Gao, W., Li, B., and Wang, L. (2020). “Locating charging stations for electric vehicles.” Transport Policy, 98, 48–54.
US Department of Energy. Alternative Fueling Station Locator. <https://afdc.energy.gov/stations/#/find/nearest/>(Mar 7 2023).
Unterluggauer, T., Rich, J., Andersen, P. B., and Hashemi, S. (2022). “Electric vehicle charging infrastructure planning for integrated transportation and power distribution networks: A review. Etransportation, 100163.
Yagmahan, B., and Yilmaz, H. (2023). “An integrated ranking approach based on group multi-criteria decision making and sensitivity analysis to evaluate charging stations under sustainability.” Environment, Development and Sustainability, 25(1). 96–121.
Yang, M., Zhang, L., Zhao, Z., and Wang, L. (2021). Comprehensive benefits analysis of electric vehicle charging station integrated photovoltaic and energy storage. Journal of Cleaner Production, 302, 126967.
Zhang, Y., Teoh, B. K., and Zhang, L. (2022). “Integrated Bayesian networks with GIS for electric vehicle charging site selection.” Journal of Cleaner Production, 344, 131049.

Information & Authors

Information

Published In

Go to Computing in Civil Engineering 2023
Computing in Civil Engineering 2023
Pages: 680 - 688

History

Published online: Jan 25, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

1Smart and Sustainable Human-Urban-Building Interactions Laboratory, School of Construction Management Technology, Purdue Univ., West Lafayette, IN. ORCID: https://orcid.org/0000-0003-2649-2069. Email: [email protected]
Soowon Chang, Ph.D., A.M.ASCE [email protected]
2Assistant Professor and Director of Smart and Sustainable Human-Urban-Building Interactions Laboratory, School of Construction Management Technology, Purdue Univ., West Lafayette, IN. ORCID: https://orcid.org/0000-0003-4877-2934. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$266.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$266.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share