Deep Reinforcement Learning for Optimal Planning of Fast Electric Vehicle Charging Stations at a Large Scale
Publication: Computing in Civil Engineering 2023
ABSTRACT
Electric vehicles (EVs) have been widely adopted with the expectation of reducing CO2 emissions. However, the lack of public fast charging stations has hindered the growth of EVs. Despite extensive research on optimal installation of EV charging stations (EVCS), a decision model for a large scale and diverse spatial conditions has been still lacking. This research intends to explore a deep reinforcement learning model using deep Q-network (DQN) algorithms and test the model for optimal planning of fast EVCS at a large scale. The DQN model considers geographic (e.g., building footprints, street network), economic (e.g., capacity of charging station), and environmental (e.g., solar energy) perspectives. The learning model identifies the energy balance between electricity generation and consumption and investigates spatial patterns nearby potential charging stations. This study can aid in decision-making for suitable EVCS sites with advancing the microgrid approach-based infrastructure systems, ultimately enhancing urban sustainability considering vehicle-to-building integration.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Abdullah, H. M., Gastli, A., Ben-Brahim, L., and Mohammed, S. O. (2022). “Planning and optimizing electric-vehicle charging infrastructure through system dynamics.” IEEE Access, 10. 17495–17514.
AECOM. (2019). City of Chicago greenhouse gas inventory report, City of Chicago.
Arias, A., Sanchez, J., and Granada, M. (2018). “Integrated planning of electric vehicles routing and charging stations location considering transportation networks and power distribution systems. International Journal of Industrial Engineering Computations, 9(4). 535–550.
Chicago Data Portal. Average daily traffic counts – Map, City of Chicago.
Chicago Metropolitan Agency for Planning. Land Use Data. <https://cmap.illinois.gov/data/land-use>(Mar 7 2023).
EIA (US Energy Information Administration). (2022). “Energy and the environment explained Where greenhouse gases come from” EIA, https://eia.gov/energyexplained/energy-and-the-environment/where-greenhouse-gases-come-from.php (Mar 3, 2023).
Google project sunroof. <https://www.google.com/get/sunroof/data-explorer/>(Mar 7 2023).
Guo, S., and Zhao, H. (2015). “Optimal site selection of electric vehicle charging station by using fuzzy TOPSIS based on sustainability perspective.” Applied Energy, 158. 390–402.
Heo, J., and Chang, S. (2022b). “Economic and environmental impacts of installation of fast charging on existing buildings for V2B uses.” Energy, The 14th International Conference on Applied Energy, 29: 2965. Bochum, Germany (Virtual).
Ilsos.gov. (2023). Illinois secretary of state active registration counts – Cook county, Office of the Illinois secretary of state.
Kong, W., Luo, Y., Feng, G., Li, K., and Peng, H. (2019). “Optimal location planning method of fast charging station for electric vehicles considering operators, drivers, vehicles, traffic flow and power grid.” Energy, 186, 115826.
Pan, A., Zhao, T., Yu, H., and Zhang, Y. (2019). “Deploying public charging stations for elctric taxis: A charging demand simulation embedded approach.” IEEE Access, 7.17412–17424.
Sun, Z., Gao, W., Li, B., and Wang, L. (2020). “Locating charging stations for electric vehicles.” Transport Policy, 98, 48–54.
US Department of Energy. Alternative Fueling Station Locator. <https://afdc.energy.gov/stations/#/find/nearest/>(Mar 7 2023).
Unterluggauer, T., Rich, J., Andersen, P. B., and Hashemi, S. (2022). “Electric vehicle charging infrastructure planning for integrated transportation and power distribution networks: A review. Etransportation, 100163.
Yagmahan, B., and Yilmaz, H. (2023). “An integrated ranking approach based on group multi-criteria decision making and sensitivity analysis to evaluate charging stations under sustainability.” Environment, Development and Sustainability, 25(1). 96–121.
Yang, M., Zhang, L., Zhao, Z., and Wang, L. (2021). Comprehensive benefits analysis of electric vehicle charging station integrated photovoltaic and energy storage. Journal of Cleaner Production, 302, 126967.
Zhang, Y., Teoh, B. K., and Zhang, L. (2022). “Integrated Bayesian networks with GIS for electric vehicle charging site selection.” Journal of Cleaner Production, 344, 131049.
Information & Authors
Information
Published In
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- [Inorganic compounds]
- Air pollution
- Artificial intelligence and machine learning
- Carbon compounds
- Carbon dioxide
- Chemicals
- Chemistry
- Computer programming
- Computing in civil engineering
- Electric power
- Emissions
- Energy engineering
- Energy infrastructure
- Engineering fundamentals
- Environmental engineering
- Highway transportation
- Infrastructure
- Lifeline systems
- Models (by type)
- Neural networks
- Organic compounds
- Pollution
- Power plants
- Scale models
- Transportation engineering
- Vehicles
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.