Abstract
Big data has emerged as an attractive concept in various industry domains. For power engineering, enormous amounts of data from different devices, different geographical locations of the power grid, and different time scales are collected, which creates the research opportunity for power big data. This paper conducted a comprehensive up-to-date literature review and a preliminary discussion of this emerging research topic. The definition, structure, and characteristics of the power big data were introduced. The technical architecture for power big data analysis was elaborated. Typical state-of-the-art applications of power big data were reviewed and discussed. This paper provided a comprehensive review of this promising topic, and a deep insight to help utility companies transform data into information, information into knowledge, and knowledge into wisdom.
Get full access to this article
View all available purchase options and get full access to this article.
References
Aitzhan, N. Z., and D. Svetinovic. 2018. “Security and privacy in decentralized energy trading through multi-signatures, Blockchain and anonymous messaging streams.” IEEE Trans. Dependable Secure Comput. 15 (5): 840–852. https://doi.org/10.1109/TDSC.2016.2616861.
Albert, A., and R. Rajagopal. 2013. “Smart meter driven segmentation: What your consumption says about you.” IEEE Trans. Power Syst. 28 (4): 4019–4030. https://doi.org/10.1109/TPWRS.2013.2266122.
Albert, A., and R. Rajagopal. 2018. “Finding the right consumers for thermal demand-response: An experimental evaluation.” IEEE Trans. Smart Grid 9 (2): 564–572. https://doi.org/10.1109/TSG.2016.2555985.
Amin, M., and B. F. Wollenberg. 2005. “Toward a smart grid-power delivery for the 21st century.” IEEE Power Energy Mag. 1 (5): 114. https://doi.org/10.1109/MPAE.2005.1507024.
Amjady, N., and S. F. Majedi. 2007. “Transient stability prediction by a hybrid intelligent system.” IEEE Trans. Power Syst. 22 (3): 1275–1283. https://doi.org/10.1109/TPWRS.2007.901667.
Australian Energy Market Operator. 2016. Black system South Australia 28 September 2016. Melbourne, Australia: Australian Energy Market Operator.
Bobadilla, J., F. Ortega, A. Hernando, and A. Gutiérrez. 2013. “Recommender systems survey.” Knowl.-Based Syst. 46 (1): 109–132. https://doi.org/10.1016/j.knosys.2013.03.012.
Chen, X., Z. Y. Dong, K. Meng, Y. Xu, K. P. Wong, and H. W. Ngan. 2012. “Electricity price forecasting with extreme learning machine and bootstrapping.” IEEE Trans. Power Syst. 27 (4): 2055–2062. https://doi.org/10.1109/TPWRS.2012.2190627.
China National Energy Board. 2016. 2015 national electric power dispatch trading and market order.. China National Energy Board.
Cui, M., D. Ke, Y. Sun, D. Gan, J. Zhang, and B. M. Hodge. 2015. “Wind power ramp event forecasting using a stochastic scenario generation method.” IEEE Trans. Sustainable Energy 6 (2): 422–433. https://doi.org/10.1109/TSTE.2014.2386870.
Dimeas, A. L., and N. D. Hatziargyriou. 2005. “Operation of a multiagent system for microgrid control.” IEEE Trans. Power Syst. 20 (3): 1447–1455. https://doi.org/10.1109/TPWRS.2005.852060.
Dong, Z. Y., Y. Xu, P. Zhang, and K. P. Wong. 2013. “Using IS to assess an electric power system’s real-time stability.” IEEE Intell. Syst. 28 (4): 60–66. https://doi.org/10.1109/MIS.2011.41.
Gautam, D., V. Vittal, and T. Harbour. 2009. “Impact of increased penetration of DFIG-based wind turbine generators on transient and small signal stability of power systems.” IEEE Trans. Power Syst. 24 (3): 1426–1434. https://doi.org/10.1109/TPWRS.2009.2021234.
Genc, I., R. Diao, V. Vittal, S. Kolluri, and S. Mandal. 2010. “Decision tree-based preventive and corrective control applications for dynamic security enhancement in power systems.” IEEE Trans. Power Syst. 25 (3): 1611–1619. https://doi.org/10.1109/TPWRS.2009.2037006.
Giri, J., D. Sun, and R. Avila-Rosales. 2009. “Wanted: A more intelligent grid.” IEEE Power Energy Mag. 7 (2): 34–40. https://doi.org/10.1109/MPE.2008.931391.
Hashem, I. A. T., I. Yaqoob, N. B. Anuar, S. Mokhtar, A. Gani, and S. U. Khan. 2015. “The rise of ‘big data’ on cloud computing: Review and open research issues.” Inf. Syst. 47 (1): 98–115. https://doi.org/10.1016/j.is.2014.07.006.
He, X., Q. Ai, R. C. Qiu, W. Huang, L. Piao, and H. Liu. 2017. “A big data architecture design for smart grids based on random matrix theory.” IEEE Trans. Smart Grid 8 (2): 674–686. https://doi.org/10.1109/TSG.2015.2445828.
Kong, W., Z. Y. Dong, D. J. Hill, F. Luo, and Y. Xu. 2016a. “Improving nonintrusive load monitoring efficiency via a hybrid programing method.” IEEE Trans. Ind. Inf. 12 (6): 2148–2157. https://doi.org/10.1109/TII.2016.2590359.
Kong, W., Z. Y. Dong, D. J. Hill, F. Luo, and Y. Xu. 2018. “Short-term residential load forecasting based on resident behaviour learning.” IEEE Trans. Power Syst. 33 (1): 1087–1088. https://doi.org/10.1109/TPWRS.2017.2688178.
Kong, W., Z. Y. Dong, Y. Xu, and D. Hill. 2016b. “An enhanced bootstrap filtering method for non-intrusive load monitoring.” In Proc., Power and Energy Society General Meeting (PESGM), 1–5. New York: IEEE.
Kosterev, D. N., C. W. Taylor, and W. A. Mittelstadt. 1999. “Model validation for the August 10, 1996 WSCC system outage.” IEEE Trans. Power Syst. 14 (3): 967–979. https://doi.org/10.1109/59.780909.
Kundur, P., et al. 2004. “Definition and classification of power system stability.” IEEE Trans. Power Syst. 19 (2): 1387–1401. https://doi.org/10.1109/TPWRS.2004.825981.
Kwac, J., J. Flora, and R. Rajagopal. 2014. “Household energy consumption segmentation using hourly data.” IEEE Trans. Smart Grid 5 (1): 420–430. https://doi.org/10.1109/TSG.2013.2278477.
LeCun, Y., Y. Bengio, and G. Hinton. 2015. “Deep learning” Nature 521 (7553): 436. https://doi.org/10.1038/nature14539.
Liang, G., S. R. Weller, F. Luo, J. Zhao, and Z. Y. Dong. 2018a. “Distributed Blockchain-based data protection framework for modern power systems against cyber attacks.” IEEE Trans. Smart Grid, in press. https://doi.org/10.1109/TSG.2018.2819663.
Liang, G., S. R. Weller, F. Luo, J. Zhao, and Z. Y. Dong. 2018b. “Generalized FDIA-based cyber topology attack with application to the Australian electricity market trading mechanism.” IEEE Trans. Smart Grid 9 (4): 3820–3829. https://doi.org/10.1109/TSG.2017.2677911.
Liang, G., S. R. Weller, J. Zhao, F. Luo, and Z. Y. Dong. 2017a. “The 2015 Ukraine blackout: Implications for false data injection attacks.” IEEE Trans. Power Syst. 32 (4): 3317–3318. https://doi.org/10.1109/TPWRS.2016.2631891.
Liang, G., J. Zhao, F. Luo, S. R. Weller, and Z. Y. Dong. 2017b. “A review of false data injection attacks against modern power systems.” IEEE Trans. Smart Grid 8 (4): 1630–1638. https://doi.org/10.1109/TSG.2015.2495133.
Liu, Y., Y. Sun, D. Infield, Y. Zhao, S. Han, and J. Yan. 2017. “A hybrid forecasting method for wind power ramp based on orthogonal test and support vector machine (OT-SVM).” IEEE Trans. Sustainable Energy 8 (2): 451–457. https://doi.org/10.1109/TSTE.2016.2604852.
LO3 Energy. 2018. “LO3 energy: The Future of energy.” Accessed September 13, 2018. https://lo3energy.com/.
Luo, F., Y. Chen, Z. Xu, G. Liang, Y. Zheng, and J. Qiu. 2017a. “Multiagent-based cooperative control framework for microgrids’ energy imbalance.” IEEE Trans. Ind. Inf. 13 (3): 1046–1056. https://doi.org/10.1109/TII.2016.2591918.
Luo, F., Z. Y. Dong, Y. Chen, Y. Xu, K. Meng, and K. P. Wong. 2012. “Hybrid cloud computing platform: The next generation IT backbone for smart grid.” In Proc., Power and Energy Society General Meeting, 1–7. New York: IEEE.
Luo, F., Z. Y. Dong, J. Zhao, X. Zhang, W. Kong, and Y. Chen. 2015. “Enabling the big data analysis in the smart grid.” In Proc., Power and Energy Society General Meeting, 1–5. New York: IEEE.
Luo, F., G. Ranzi, W. Kong, Z. Y. Dong, S. Wang, and J. Zhao. 2017b. “Non-intrusive energy saving appliance recommender system for smart grid residential users.” IET Gener. Transm. Distrib. 11 (7): 1786–1793. https://doi.org/10.1049/iet-gtd.2016.1615.
Luo, F., G. Ranzi, X. Wang, and Z. Y. Dong. 2016a. “Service recommendation in smart grid: Vision, technologies, and applications.” In Proc., 9th Int. Conf. on Service Science (ICSS), 31–38. New York: IEEE.
Luo, F., G. Ranzi, X. Wang, and Z. Y. Dong. 2017c. “Social information filtering based electricity retail plan recommender system for smart grid end users.” IEEE Trans. Smart Grid 10 (1): 95–104. https://doi.org/10.1109/TSG.2017.2732346.
Luo, F., J. Zhao, Z. Y. Dong, Y. Chen, Y. Xu, X. Zhang, and K. P. Wong. 2016b. “Cloud-based information infrastructure for next-generation power grid: Conception, architecture, and applications.” IEEE Trans. Smart Grid 7 (4): 1896–1912. https://doi.org/10.1109/TSG.2015.2452293.
Luo, F., J. Zhao, Z. Y. Dong, X. Tong, Y. Chen, H. Yang, and H. Zhang. 2016c. “Optimal dispatch of air conditioner loads in southern China region by direct load control.” IEEE Trans. Smart Grid 7 (1): 439–450. https://doi.org/10.1109/TSG.2014.2388233.
Ma, J., D. Han, R. M. He, Z. Y. Dong, and D. J. Hill. 2008. “Reducing identified parameters of measurement-based composite load model.” IEEE Trans. Power Syst. 23 (1): 76–83. https://doi.org/10.1109/TPWRS.2007.913206.
Milanovic, J. V., K. Yamashita, S. M. Villanueva, S. Ž. Djokic, and L. M. Korunović. 2013. “International industry practice on power system load modeling.” IEEE Trans. Power Syst. 28 (3): 3038–3046. https://doi.org/10.1109/TPWRS.2012.2231969.
Rajapakse, A. D., F. Gomez, K. Nanayakkara, P. A. Crossley, and V. V. Terzija. 2010. “Rotor angle instability prediction using post-disturbance voltage trajectories.” IEEE Trans. Power Syst. 25 (2): 947–956. https://doi.org/10.1109/TPWRS.2009.2036265.
Sun, K., S. Likhate, V. Vittal, V. S. Kolluri, and S. Mandal. 2007. “An online dynamic security assessment scheme using phasor measurements and decision trees.” IEEE Trans. Power Syst. 22 (4): 1935–1943. https://doi.org/10.1109/TPWRS.2007.908476.
Wang, L., et al. 2014a. “Bigdatabench: A big data benchmark suite from internet services.” In Proc., 20th Int. Symp. on High Performance Computer Architecture (HPCA), 488–499. New York: IEEE.
Wang, Z., B. Chen, J. Wang, J. Kim, and M. M. Begovic. 2014b. “Robust optimization based optimal DG placement in microgrids.” IEEE Trans. Smart Grid 5 (5): 2173–2182. https://doi.org/10.1109/TSG.2014.2321748.
Wedde, H. F., S. Lehnhoff, E. Handschin, and O. Krause. 2006. “Real-time multi-agent support for decentralized management of electric power.” In Proc., 18th Euromicro Conf. on Real-Time Systems, 9. New York: IEEE.
Xu, Y., Z. Y. Dong, L. Guan, R. Zhang, K. P. Wong, and F. Luo. 2012a. “Preventive dynamic security control of power systems based on pattern discovery technique.” IEEE Trans. Power Syst. 27 (3): 1236–1244. https://doi.org/10.1109/TPWRS.2012.2183898.
Xu, Y., Z. Y. Dong, K. Meng, R. Zhang, and K. P. Wong. 2011. “Real-time transient stability assessment model using extreme learning machine.” IET Gener. Transm. Distrib. 5 (3): 314–322. https://doi.org/10.1049/iet-gtd.2010.0355.
Xu, Y., Z. Y. Dong, R. Zhang, and K. Po Wong. 2013. “A decision tree-based on-line preventive control strategy for power system transient instability prevention.” Int. J. Syst. Sci. 45 (2): 176–186. https://doi.org/10.1080/00207721.2011.626906.
Xu, Y., Z. Y. Dong, J. H. Zhao, P. Zhang, and K. P. Wong. 2012b. “A reliable intelligent system for real-time dynamic security assessment of power systems.” IEEE Trans. Power Syst. 27 (3): 1253–1263. https://doi.org/10.1109/TPWRS.2012.2183899.
Xu, Y., J. Ma, Z. Y. Dong, and D. J. Hill. 2017. “Robust transient stability-constrained optimal power flow with uncertain dynamic loads.” IEEE Trans. Smart Grid 8 (4): 1911–1921. https://doi.org/10.1109/TSG.2015.2510447.
Yang, J., J. Zhao, F. Luo, F. Wen, and Z. Y. Dong. 2018. “Decision-making for electricity retailers: A brief survey.” IEEE Trans. Smart Grid 9 (5): 4140–4153. https://doi.org/10.1109/TSG.2017.2651499.
Zhang, R., Y. Xu, Z. Y. Dong, and D. J. Hill. 2012. “Feature selection for intelligent stability assessment of power systems.” In Proc., Power and Energy Society General Meeting, 1–7. New York: IEEE.
Zhang, C., Y. Xu, Z. Y. Dong, and J. Ma. 2017a. “Robust operation of microgrids via two-stage coordinated energy storage and direct load control.” IEEE Trans. Power Syst. 32 (4): 2858–2868. https://doi.org/10.1109/TPWRS.2016.2627583.
Zhang, R., Z. Y. Dong, Y. Xu, K. Meng, and K. P. Wong. 2013. “Short-term load forecasting of Australian National Electricity Market by an ensemble model of extreme learning machine.” IET Gener. Transm. Distrib. 7 (4): 391–397. https://doi.org/10.1049/iet-gtd.2012.0541.
Zhang, Y., Y. Xu, and Z. Y. Dong. 2018. “Robust ensemble data analytics for incomplete PMU measurements-based power system stability assessment.” IEEE Trans. Power Syst. 33 (1): 1124–1126. https://doi.org/10.1109/TPWRS.2017.2698239.
Zhang, R., Y. Xu, Z. Y. Dong, and K. P. Wong. 2016. “Measurement-based dynamic load modelling using time-domain simulation and parallel-evolutionary search.” IET Gener. Transm. Distrib. 10 (15): 3893–3900. https://doi.org/10.1049/iet-gtd.2016.0579.
Zhang, Y., Y. Xu, Z. Y. Dong, Z. Xu, and K. P. Wong. 2017b. “Intelligent early warning of power system dynamic insecurity risk: Toward optimal accuracy-earliness tradeoff.” IEEE Trans. Ind. Inf. 13 (5): 2544–2554. https://doi.org/10.1109/TII.2017.2676879.
Information & Authors
Information
Published In
Journal of Energy Engineering
Volume 145 • Issue 3 • June 2019
Copyright
©2019 American Society of Civil Engineers.
History
Received: Jun 12, 2018
Accepted: Nov 13, 2018
Published online: Mar 26, 2019
Published in print: Jun 1, 2019
Discussion open until: Aug 26, 2019
ASCE Technical Topics:
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.