From Slide Rule to Big Data: How Data Science is Changing Water Science and Engineering
Publication: Journal of Environmental Engineering
Volume 145, Issue 8
Abstract
Forum papers are thought-provoking opinion pieces or essays founded in fact, sometimes containing speculation, on a civil engineering topic of general interest and relevance to the readership of the journal. The views expressed in this Forum article do not necessarily reflect the views of ASCE or the Editorial Board of the journal.
Formats available
You can view the full content in the following formats:
Acknowledgments
I am, by no means, an expert in this field and am obviously much too old to be considered a digital native. For their constructive comments on this manuscript, I would like to thank my younger and/or more expert colleagues at Eawag (additional affiliations in parentheses): Carlo Albert, Florian Altermatt (University of Zurich), Damien Bouffard, Juan Pablo Carbajal, Francesco Pomati, Peter Reichert, Nele Schuwirth, Jonas Šukys, Kris Villez, and A. Johny Wüest (EPFL). I also thank Miguel Mahecha (MPI Biogeochemistry) and two anonymous reviewers for their helpful comments.
References
Allen, G. H., and T. M. Pavelsky. 2018. “Global extent of rivers and streams.” Science 361 (6402): 585–588. https://doi.org/10.1126/science.aat0636.
Alley, G. 2018. “What is a data pipeline?” Accessed December 12, 2018. https://www.alooma.com/blog/what-is-a-data-pipeline.
Basco-Carrera, L., A. Warren, E. van Beek, A. Jonoski, and A. Giardino. 2017. “Collaborative modelling or participatory modelling? A framework for water resources management.” Environ. Modell. Software 91 (May): 95–110. https://doi.org/10.1016/j.envsoft.2017.01.014.
Bouffard, D., I. Kiefer, A. Wuest, S. Wunderle, and D. Odermatt. 2018. “Are surface temperature and chlorophyll in a large deep lake related? An analysis based on satellite observations in synergy with hydrodynamic modelling and in-situ data.” Remote Sens. Environ. 209 (May): 510–523. https://doi.org/10.1016/j.rse.2018.02.056.
Broadhurst, D. I., and D. B. Kell. 2006. “Statistical strategies for avoiding false discoveries in metabolomics and related experiments.” Metabolomics 2 (4): 171–196. https://doi.org/10.1007/s11306-006-0037-z.
Bueno de la Fuente, G. n.d. “What is open science? Introduction.” Accessed December 13, 2008. https://www.fosteropenscience.eu/content/what-open-science-introduction.
Burthe, S. J., et al. 2016. “Do early warning indicators consistently predict nonlinear change in long-term ecological data?” J. Appl. Ecol. 53 (3): 666–676. https://doi.org/10.1111/1365-2664.12519.
Bush, A., et al. 2017. “Connecting Earth observation to high-throughput biodiversity data.” Nat. Ecol. Evol. 1 (7): 0176. https://doi.org/10.1038/s41559-017-0176.
Carpenter, S. R., W. A. Brock, C. Folke, E. H. van Nes, and M. Scheffer. 2015. “Allowing variance may enlarge the safe operating space for exploited ecosystems.” Proc. Natl. Acad. Sci. U.S.A. 112 (46): 14384–14389. https://doi.org/10.1073/pnas.1511804112.
Chao, B. F., Y. H. Wu, and Y. S. Li. 2008. “Impact of artificial reservoir water impoundment on global sea level.” Science 320 (5873): 212–214. https://doi.org/10.1126/science.1154580.
Corominas, L., M. Garrido-Baserba, K. Villez, G. Olsson, U. Cortes, and M. Poch. 2018. “Transforming data into knowledge for improved wastewater treatment operation: A critical review of techniques.” Environ. Modell. Software 106 (Aug): 89–103. https://doi.org/10.1016/j.envsoft.2017.11.023.
Cox, D. R. 2015. “Big data and precision.” Biometrika 102 (3): 712–716. https://doi.org/10.1093/biomet/asv033.
CUAHSI (Consortium of Universities for the Advancement of Hydrologic Science). 2019. “Data portals.” Accessed May 3, 2019. https://www.cuahsi.org/data-models/portals/.
Dafforn, K. A., E. L. Johnston, A. Ferguson, C. L. Humphrey, W. Monk, S. J. Nichols, S. L. Simpson, M. G. Tulbure, and D. J. Baird. 2016. “Big data opportunities and challenges for assessing multiple stressors across scales in aquatic ecosystems.” Mar. Freshwater Res. 67 (4): 393–413. https://doi.org/10.1071/MF15108.
Davis, J., et al. 2015. “When trends intersect: The challenge of protecting freshwater ecosystems under multiple land use and hydrological intensification scenarios.” Sci. Total Environ. 534 (Nov): 65–78. https://doi.org/10.1016/j.scitotenv.2015.03.127.
Deplazes-Zemp, A., S. Abiven, P. Schaber, M. Schaepman, G. Schaepman-Strub, B. Schmid, K. K. Shimizu, and F. Altermatt. 2018. “The Nagoya Protocol could backfire on the global South.” Nat. Ecol. Evol. 2 (6): 917–919. https://doi.org/10.1038/s41559-018-0561-z.
Doell, P., K. Fiedler, and J. Zhang. 2009. “Global-scale analysis of river flow alterations due to water withdrawals and reservoirs.” Hydrol. Earth Syst. Sci. 13 (12): 2413–2432. https://doi.org/10.5194/hess-13-2413-2009.
Dornelas, M., et al. 2018. “BioTIME: A database of biodiversity time series for the Anthropocene.” Global Ecol. Biogeogr. 27 (7): 760–786. https://doi.org/10.1111/geb.12729.
Durden, J. M., J. Y. Luo, H. Alexander, A. M. Flanagan, and L. Grossmann. 2017. “Integrating “big data” into aquatic ecology: Challenges and opportunities.” Limnol. Oceanogr. Bull. 26 (4): 101–108. https://doi.org/10.1002/lob.10213.
EPFL IRGC (Ecole polytechnique fédérale de Lausanne International Risk Governance Center). 2018. “The governance of decision-making algorithms.” Accessed December 13, 2018. https://irgc.epfl.ch/wp-content/uploads/2018/12/IRGC-2018-The-Governance-of-Decision-Making-Algorithms-Workshop-report.pdf.
Fan, H., D. M. He, and H. L. Wang. 2015. “Environmental consequences of damming the mainstream Lancang-Mekong River: A review.” Earth-Sci. Rev 146 (Jul): 77–91. https://doi.org/10.1016/j.earscirev.2015.03.007.
Farley, S. S., A. Dawson, S. J. Goring, and J. W. Williams. 2018. “Situating ecology as a big-data science: Current advances, challenges, and solutions.” Bioscience 68 (8): 563–576. https://doi.org/10.1093/biosci/biy068.
Gaudard, A., L. Råman Vinnå, F. Bärenbold, M. Schmid, and D. Bouffard. 2019. “Toward an open-access of high-frequency lake modelling and statistics data for scientists and practitioners. The case of Swiss Lakes using Simstrat v2.1.” Geosci. Model Dev. Discuss. https://doi.org/10.5194/gmd-2018-336.
GBIF (Global Biodiversity Information Facility). n.d. “An alliance for biodiversity knowledge.” Accessed May 8, 2019. https://www.biodiversityinformatics.org/.
Geist, J., and S. J. Hawkins. 2016. “Habitat recovery and restoration in aquatic ecosystems: Current progress and future challenges.” Aquat. Conserv. Mar. Freshwater Ecosyst. 26 (5): 942–962. https://doi.org/10.1002/aqc.2702.
Gewin, V. 2016. “Data sharing: An open mind on open data.” Nature 529 (7584): 117–119. https://doi.org/10.1038/nj7584-117a.
Gligorov, V. V. 2015. “Real-time data analysis at the LHC: Present and future.” Accessed May 8, 2019. http://proceedings.mlr.press/v42/glig14.pdf.
Griffin, R. E. 2015. “When are old data new data?” Geo. Res. J. 6 (Jun): 92–97. https://doi.org/10.1016/j.grj.2015.02.004.
Grill, G., B. Lehner, A. E. Lumsdon, G. K. MacDonald, C. Zarfl, and C. R. Liermann. 2015. “An index-based framework for assessing patterns and trends in river fragmentation and flow regulation by global dams at multiple scales.” Environ. Res. Lett. 10 (1): 015001. https://doi.org/10.1088/1748-9326/10/1/015001.
Hering, J. G., L. Nunnemacher, and H. von Waldow. 2018. “Perspectives from a water research institute on knowledge management for sustainable water management.” In Handbook of knowledge management for sustainable water systems, 13–33. Edited by M. Russ. New York: Wiley.
Hering, J. G., and K. Vairavamoorthy. 2018. “Harvesting experience to support sustainable urban water management.” In Assessing global water megatrends, 61–75. Edited by A. K. Biswas, C. Tortajada, and P. Rohner. Berlin: Springer.
Hutton, C., T. Wagener, J. Freer, D. Han, C. Duffy, and B. Arheimer. 2016. “Most computational hydrology is not reproducible, so is it really science?” Water Resour. Res. 52 (10): 7548–7555. https://doi.org/10.1002/2016WR019285.
Ilie, I., et al. 2017. “Reverse engineering model structures for soil and ecosystem respiration: The potential of gene expression programming.” Geosci. Model Dev. 10 (9): 3519–3545. https://doi.org/10.5194/gmd-10-3519-2017.
Ingildsen, P., and G. Olsson. 2016. Smart water utilities: Complexity made simple, 304. London: IWA Publishing.
Kondolf, G. M., Z. K. Rubin, and J. T. Minear. 2014. “Dams on the Mekong: Cumulative sediment starvation.” Water Resour. Res. 50 (6): 5158–5169. https://doi.org/10.1002/2013WR014651.
Langsdale, S., A. Beall, E. Bourget, E. Hagen, S. Kudlas, R. Palmer, D. Tate, and W. Werick. 2013. “Collaborative modeling for decision support in water resources: Principles and best practices.” J. Am. Water Resour. Assoc. 49 (3): 629–638. https://doi.org/10.1111/jawr.12065.
Lehner, B., et al. 2011. “High-resolution mapping of the world’s reservoirs and dams for sustainable river-flow management.” Front. Ecol. Environ. 9 (9): 494–502. https://doi.org/10.1890/100125.
Li, J., K. A. Skinner, R. M. Eustice, and M. Johnson-Roberson. 2018. “WaterGAN: Unsupervised generative network to enable real-time color correction of monocular underwater images.” IEEE Rob. Autom. Lett. 3 (1): 387–394. https://doi.org/10.1109/lra.2017.2730363.
Maavara, T., C. T. Parsons, C. Ridenour, S. Stojanovic, H. H. Durr, H. R. Powley, and P. Van Cappellen. 2015. “Global phosphorus retention by river damming.” Proc. Natl. Acad. Sci. U.S.A. 112 (51): 15603–15608. https://doi.org/10.1073/pnas.1511797112.
Matthews, M. W., and D. Odermatt. 2015. “Improved algorithm for routine monitoring of cyanobacteria and eutrophication in inland and near-coastal waters.” Remote Sens. Environ. 156 (Jan): 374–382. https://doi.org/10.1016/j.rse.2014.10.010.
McCabe, M. F., et al. 2017. “The future of Earth observation in hydrology.” Hydrol. Earth Syst. Sci. 21 (7): 3879–3914. https://doi.org/10.5194/hess-21-3879-2017.
McGowan, J. A., E. R. Deyle, H. Ye, M. L. Carter, C. T. Perretti, K. D. Seger, A. de Verneil, and G. Sugihara. 2017. “Predicting coastal algal blooms in southern California.” Ecology 98 (5): 1419–1433. https://doi.org/10.1002/ecy.1804.
Odermatt, D., O. Danne, P. Philipson, and C. Brockmann. 2018. “Diversity II water quality parameters from ENVISAT (2002-2012): A new global information source for lakes.” Earth Syst. Sci. Data 10 (3): 1527–1549. https://doi.org/10.5194/essd-10-1527-2018.
Parrott, L. 2017. “The modelling spiral for solving ‘wicked’ environmental problems: Guidance for stakeholder involvement and collaborative model development.” Methods Ecol. Evol. 8 (8): 1005–1011. https://doi.org/10.1111/2041-210X.12757.
Paull, C. K., et al. 2018. “Powerful turbidity currents driven by dense basal layers.” Nat. Commun. 9 (1): 4114. https://doi.org/10.1038/s41467-018-06254-6.
Pearl, J. 2018. “Theoretical impediments to machine learning with seven sparks from the causal revolution.” Preprint, submitted January 11, 2018. https://arxiv.org/abs/1801.04016.
Pennekamp, F., et al. 2018. “Biodiversity increases and decreases ecosystem stability.” Nature 563 (7729): 109–112. https://doi.org/10.1038/s41586-018-0627-8.
Pennekamp, F., J. I. Griffiths, E. A. Fronhofer, A. Garnier, M. Seymour, F. Altermatt, and O. L. Petchey. 2017. “Dynamic species classification of microorganisms across time, abiotic and biotic environments-A sliding window approach.” PLoS ONE 12 (5): e0176682. https://doi.org/10.1371/journal.pone.0176682.
Peters, D. P. C., et al. 2018. “An integrated view of complex landscapes: A big data-model integration approach to transdisciplinary science.” Bioscience 68 (9): 653–669. https://doi.org/10.1093/biosci/biy069.
Peters, D. P. C., K. M. Havstad, J. Cushing, C. Tweedie, O. Fuentes, and N. Villanueva-Rosales. 2014. “Harnessing the power of big data: Infusing the scientific method with machine learning to transform ecology.” Ecosphere 5 (6): 1–15. https://doi.org/10.1890/ES13-00359.1.
Pinho, A. J., D. Pratas, and S. P. Garcia. 2012. “GReEn: A tool for efficient compression of genome resequencing data.” Nucleic Acids Res. 40 (4): e27. https://doi.org/10.1093/nar/gkr1124.
Ramaswami, A., A. G. Russell, P. J. Culligan, K. R. Sharma, and E. Kumar. 2016. “Meta-principles for developing smart, sustainable, and healthy cities.” Science 352 (6288): 940–943. https://doi.org/10.1126/science.aaf7160.
RDA (Research Data Alliance). n.d. “Research Data.” Accessed May 8, 2019. https://www.rd-alliance.org/.
SDSC (Swiss Data Science Center). n.d. “Data Science.” Accessed May 8, 2019. https://datascience.ch/.
Shen, C. 2018. “A transdisciplinary review of deep learning research and its relevance for water resources scientists.” Water Resour. Res. 54 (11): 8558–8593. https://doi.org/10.1029/2018WR022643.
Shen, C., et al. 2018. “HESS Opinions: Incubating deep-learning-powered hydrologic science advances as a community.” Hydrol. Earth Syst. Sci. 22 (11): 5639–5656. https://doi.org/10.5194/hess-22-5639-2018.
Strobl, C., A.-L. Boulesteix, T. Kneib, T. Augustin, and A. Zeileis. 2008. “Conditional variable importance for random forests.” BMC Bioinf. 9 (1): 307. https://doi.org/10.1186/1471-2105-9-307.
Sugihara, G., R. May, H. Ye, C.-H. Hsieh, E. Deyle, M. Fogarty, and S. Munch. 2012. “Detecting causality in complex ecosystems.” Science 338 (6106): 496–500. https://doi.org/10.1126/science.1227079.
Taormina, R., and S. Galelli. 2018. “Deep-learning approach to the detection and localization of cyber-physical attacks on water distribution systems.” J. Water Resour. Plann. Manage. 144 (10): 04018065. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000983.
Taormina, R., S. Galelli, N. O. Tippenhauer, E. Salomons, and A. Ostfeld. 2017. “Characterizing cyber-physical attacks on water distribution systems.” J. Water Resour. Plann. Manage. 143 (5): 04017009. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000749.
Termeer, C. J. A. M., and A. Dewulf. 2018. “A small wins framework to overcome the evaluation paradox of governing wicked problems.” Policy Soc. 1–17. https://doi.org/10.1080/14494035.2018.1497933.
Thomas, M. K., S. Fontana, M. Reyes, M. Kehoe, and F. Pomati. 2018a. “The predictability of a lake phytoplankton community, over time-scales of hours to years.” Ecol. Lett. 21 (5): 619–628. https://doi.org/10.1111/ele.12927.
Thomas, M. K., S. Fontana, M. Reyes, and F. Pomati. 2018b. “Quantifying cell densities and biovolumes of phytoplankton communities and functional groups using scanning flow cytometry, machine learning and unsupervised clustering.” PLoS ONE 13 (5): e0196225. https://doi.org/10.1371/journal.pone.0196225.
USGS. n.d. “Data at risk project.” Accessed December 13, 2008. https://apps.usgs.gov/ldi/data-at-risk-project.
Wilkinson, M. D., et al. 2016. “The FAIR Guiding Principles for scientific data management and stewardship.” Sci. Data 3: 160018. https://doi.org/10.1038/sdata.2016.18.
Woodward, C., J. Shulmeister, J. Larsen, G. E. Jacobsen, and A. Zawadzki. 2014. “The hydrological legacy of deforestation on global wetlands.” Science 346 (6211): 844–847. https://doi.org/10.1126/science.1260510.
Ye, H., and G. Sugihara. 2016. “Information leverage in interconnected ecosystems: Overcoming the curse of dimensionality.” Science 353 (6302): 922–925. https://doi.org/10.1126/science.aag0863.
Zarfl, C., A. E. Lumsdon, J. Berlekamp, L. Tydecks, and K. Tockner. 2015. “A global boom in hydropower dam construction.” Aquat. Sci. 77 (1): 161–170. https://doi.org/10.1007/s00027-014-0377-0.
Zhang, D., N. Martinez, G. Lindholm, and H. Ratnaweera. 2018. “Manage sewer in-line storage control using hydraulic model and recurrent neural network.” Water Resour. Manage. 32 (6): 2079–2098. https://doi.org/10.1007/s11269-018-1919-3.
Information & Authors
Information
Published In
Journal of Environmental Engineering
Volume 145 • Issue 8 • August 2019
Copyright
This work is made available under the terms of the Creative Commons Attribution 4.0 International license, http://creativecommons.org/licenses/by/4.0/.
History
Received: Jan 10, 2019
Accepted: Feb 22, 2019
Published online: May 17, 2019
Published in print: Aug 1, 2019
Discussion open until: Oct 17, 2019
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.