Comparison of Sequential and Variational Streamflow Assimilation Techniques for Short-Term Hydrological Forecasting
Publication: Journal of Hydrologic Engineering
Volume 20, Issue 2
Abstract
This study compares sequential and variational streamflow assimilation techniques for short-term hydrological forecasting based on a lumped conceptual rainfall-runoff model and two dissimilar watersheds (Canada and Germany). The assessment targets the Ensemble Kalman filter (EnKF) and variational data assimilation (VDA). Deterministic streamflow forecasts are computed on a daily time step over a 10-day forecast horizon, using meteorological observations as inputs to the model. Results show that the EnKF leads to the highest performance for all forecast horizons while the optimal set-up for the VDA, which often competes with the EnKF, varies from one watershed to the other. EnKF surpasses forecasts without assimilation for all horizons and for both watersheds where the NSE varies between 0.88 and 0.79 on the au Saumon watershed in Canada and between 0.92 and 0.87 on the Schlehdorf watershed in Germany on a 10-day horizon, which is not always true for the VDA. The naïve output assimilation is also assessed and is only helpful for the first two days of the forecasts.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The authors acknowledge NSERC, Mprime, Ouranos, and Hydro-Québec for support, as well as partners in the QBIC3 project.
References
Abaza, M., Anctil, F., Fortin, V., and Turcotte, R. (2013). “A comparison of the Canadian global and regional meteorological ensemble prediction systems for short-term hydrological forecasting.” Mon. Weather Rev., 141(10), 3462–3476.
Anderson, J. L. (2001). “An ensemble adjustment Kalman filter for data assimilation.” Mon. Weather Rev., 129(12), 2884–2903.
Andreadis, K. M., and Lettenmaier, D. P. (2006). “Assimilating remotely sensed snow observations into a macroscale hydrology model.” Adv. Water Resour., 29(6), 872–886.
Aubert, D., Loumagne, C., and Oudin, L. (2003). “Sequential assimilation of soil moisture and streamflow data in a conceptual rainfall–runoff model.” J. Hydrol., 280(4), 145–161.
Berrada, M. (2006). “Kalman filter.” Université de Pierre et Marie Curie LOCEAN-IPSL, 1–5, 〈http://www.lodyc.jussieu.fr/~mblod/Doc/klmF.pdf〉.
Berthet, L. (2010). “Prévision des crues au pas de temps horaire: Pour une meilleure assimilation de l’information de débit dans un modèle hydrologique.” Ph.D. thesis, AgroParisTech, Paris, France (in French).
Burgers, G., Van Leeuwen, P. J., and Evensen, G. (1998). “Analysis scheme in the ensemble kalman filter.” Mon. Weather Rev., 126(6), 1719–1724.
Camporese, M., Paniconi, C., Putti, M., and Salandin, P. (2009). “Ensemble Kalman filter data assimilation for a process-based catchment scale model of surface and subsurface flow.” Water Resour. Res., 45(10), W10421.
Chiew, F., and McMahon, T. (1994). “Application of the daily rainfall-runoff model MODHYDROLOG to 28 Australian catchments.” J. Hydrol., 153(1–4), 383–416.
Clark, M. P., et al. (2008). “Hydrological data assimilation with the ensemble Kalman filter: Use of streamflow observations to update states in a distributed hydrological model.” Adv. Water. Res., 31(10), 1309–1324.
Daget, N. (2007). “Review of assimilation methods.” Technical Rep. TR/CMGC/07/113 GLOBC – CERFACS, Toulouse, 74, 〈http://www.cerfacs.fr/globc/publication/technicalreport/2007/revue_methodes_assimilation.pdf〉 (in French).
Dechant, C. M., and Moradkhani, H. (2012). “Examining the effectiveness and robustness of sequential data assimilation methods for quantification of uncertainty in hydrologic forecasting.” Water Resour. Res., 48(4), W04518.
Drécourt, J. P. (2004). “Data assimilation in hydrological modeling.” Ph.D. thesis, DHI Water & Environ Dept., Technical Univ. of Denmark, 39.
Duan, Q., Sorooshian, S., and Gupta, V. (1994). “Optimal use of the SCEUA global optimization method for calibrating watershed models.” J. Hydrol., 158(4), 265–284.
Duan, Q. Y., Sorooshian, S., and Gupta, V. (1992). “Effective and efficient global optimization for conceptual rainfall-runoff models.” Water Resour. Res., 28(4), 1015–1031.
Enzo, C., Kellya, C., and Thibaut, D. (2010). “Etude de cas: Kalman filter.” 1–6, 〈http://www.rose.eu.org/2010/wp-content/uploads/2010/03/Kalman_article.pdf〉 (in Danish).
Evensen, G. (1994). “Sequential data assimilation with non-linear quasi-geostrophic model using monte carlo methods to forecast error statistics.” J. Geophys. Res., 99(C5), 10143–10162.
Evensen, G. (1997). “Advanced data assimilation for strongly nonlinear dynamics.” Mon. Weather Rev., 125(6), 1342–1354.
Evensen, G. (2003). “The ensemble Kalman filter: Theoretical formulation and practical implementation.” Ocean Dyn., 53(4), 343–367.
Fisher, M., Nocedal, J., Tremolet, Y., and Wright, S. J. (2009). “Data assimilation in weather forecasting: A case study in PDE-constrained optimization.” Optimiz. Eng., 10(3), 409–426.
Hendricks Franssen, H. J., et al. (2011). “Operational real-time modeling with ensemble Kalman filter of variably saturated subsurface flow including stream-aquifer interaction and parameter updating.” Water Resour. Res., 47(2), W02532.
Hendricks Franssen, H. J., and Kinzelbach, W. (2008). “Real-time groundwater flow modeling with the ensemble Kalman filter: Joint estimation of states and parameters and the filter inbreeding problem.” Water Resour. Res., 44(9), W09408.
Huang, X. Y., and Yang, X. (1996). “Variational data assimilation with the Lorenz model: Highresolution limited area model (HIRLAM).”, Danish Meteorol. Institute, Copenhagen, Denmark.
Kalman, R. E. (1960). “A new approach to linear filtering and prediction problem.” J. Basic Eng., 82D(1), 35–45.
Lee, H., Seo, D.-J., and Koren, V. (2011). “Assimilation of streamflow and in situ soil moisture data into operational distributed hydrologic models: Effects of uncertainties in the data and initial model soil moisture states.” Adv. Water Resour., 34(12), 1597–1615.
Lee, H., Seo, D.-J., Liu, Y., Koren, V., McKee, P., and Corby, R. (2012). “Variational assimilation of streamflow into operational distributed hydrologic model: Effect of spatiotemporal adjustment scale.” Hydrol. Earth Syst. Sci., 9(1), 93–138.
Leisenring, M., and Moradkhani, H. (2011). “Snow water equivalent prediction using Bayesian data assimilation methods.” Stochastic Environ. Res. Risk Assess., 25(2), 253–270.
Li, Y., et al. (2011). “Assimilation of streamflow discharge into a continuous flood forecasting model.” Risk in water resources management, G. Bloschl, K. Takeuchi, S. Jain, A. Farnleitner, and A. Schumann, eds., IAHS, Melbourne, Australia, 107–113.
Li, Y., Ryu, D., Western, A. W., and Wang, Q. J. (2013). “Assimilation of stream discharge for flood forecasting: The benefits of accounting for routing time lags.” Water Resour Res., 49(4), 1887–1900.
Liu, Y., et al. (2012). “Advancing data assimilation in operational hydrologic forecasting: Progresses, challenges, and emerging opportunities.” Hydrol. Earth Syst. Sci., 16(10), 3863–3887.
Liu, Y., and Gupta, H. V. (2007). “Uncertainty in hydrologic modeling: Toward an integrated data assimilation framework.” Water Resour. Res., 43(7), 1–18.
Liu, Z., Wu, S., Zhang, S., Liu, Y., and Rong, X. (2013). “Ensemble data assimilation in a simple coupled climate model: The role of ocean-atmosphere interaction.” Adv. Atmos. Sci., 30(5), 1235–1248.
Lu, H., Yu, Z., Zhu, Y., Drake, S., Hao, Z., and Sudicky, E. A. (2011). “Dual state-parameter estimation of root zone soil moisture by optimal parameter estimation and extended Kalman filter data assimilation.” Adv. Water Resour., 34(3), 395–406.
McMillan, H. K., Hreinsson, E. O., Clark, M. P., Singh, S. K., Zammit, C., and Uddstrom, M. J. (2013). “Operational hydrological data assimilation with the recursive ensemble Kalman filter.” Hydrol. Earth Syst. Sci., 17(1), 21–38.
Meier, P., Frömelt, A., and Kinzelbach, W. (2011). “Hydrological real-time modelling in the Zambezi river basin using satellite-based soil moisture and rainfall data.” Hydrol. Earth Syst. Sci., 15(3), 999–1008.
Moradkhani, H. (2008). “Hydrologic remote sensing and land surface data assimilation.” Sensors, 8(5), 2986–3004.
Moradkhani, H., DeChant, C. M., and Sorooshian, S. (2012). “Evolution of ensemble data assimilation for uncertainty quantification using the particle filter-Markov chain Monte Carlo method.” Water Resour. Res., 48(12).
Moradkhani, H., Hsu, K.-L., Gupta, H., and Sorooshian, S. (2005b). “Uncertainty assessment of hydrologic model states and parameters: Sequential data assimilation using the particle filter.” Water Resour. Res., 41(5), 1–17.
Moradkhani, H., Sorooshian, S., Gupta, H. V., and Houser, P. (2005a). “Dual state parameter estimation of hydrologic models using ensemble Kalman filter.” Adv. Water Resour., 28(2), 135–147.
Moriasi, D. N., Arnold, J. G., Van Liew, M. W., Bingner, R. L., Harmel, R. D., and Veith, T. L. (2007). “Model evaluation guidelines for systematic quantification of accuracy in watershed simulations.” Am. Soc. Agric. Biol. Eng., 50(3), 885–900.
Nash, J. E., and Sutcliffe, J. V. (1970). “River flow forecasting through conceptual models: Part I—A discussion of principles.” J. Hydrol., 10(3), 282–290.
Nie, S., Zhu, J., and Luo, Y. (2011). “Simultaneous estimation of land surface scheme states and parameters using the ensemble Kalman filter: Identical twin experiments.” Hydrol. Earth Syst. Sci., 15(8), 2437–2457.
Noh, S. J., Tachikawa, Y., Shiiba, M., and Kim, S. (2011). “Applying sequential Monte Carlo methods into a distributed hydrologic model: Lagged particle filtering approach with regularization.” Hydrol. Earth Syst. Sci., 15(10), 3237–3251.
Oudin, L., et al. (2005). “Which potential evapotranspiration input for a lumped rainfall-runoff model? Part 2—Towards a simple and efficient potential evapotranspiration model for rainfall runoff modelling.” J. Hydrol., 303(1–4), 290–306.
Oudin, L., Andréassian, V., Mathevet, T., Perrin, C., and Michel, C. (2006). “Dynamic averaging of rainfall-runoff model simulations from complementary model parameterizations.” Water Resour. Res., 42(7), W07410.
Pauwels, V. R. N., and De Lannoy, G. J. M. (2006). “Improvement of modeled soil wetness conditions and turbulent fluxes through the assimilation of observed discharge.” J. Hydrometeorol., 7(3), 458–477.
Pellenq, J., Boulet, G., Chaponniere, A., and Kerr, Y. (2003). “Soil moisture assimilation in a coupled water/energy scheme in a semiarid region.” Hydrology of the mediterranean and semiarid regions, IAHS, Montpellier, France, 9–14.
Perrin, C., Michel, C., and Andreassian, V. (2003). “Improvement of a parsimonious model for streamflow simulation.” J. Hydrol., 279(1–4), 275–289.
Pham, D. T. (2001). “Stochastic methods for sequential data assimilation in strongly nonlinear systems.” Mon. Weather Rev., 129(5), 1194–1207.
Rakovec, O., Hazenberg, P., Torfs, P. J. J. F., Weerts, A. H., and Uijlenhoet, R. (2012a). “Generating spatial precipitation ensembles: Impact of temporal correlation structure.” Hydrol. Earth Syst. Sci., 16(9), 3419–3434.
Rakovec, O., Weerts, A. H., Hazenberg, P., Torfs, P. J. J. F., and Uijlenhoet, R. (2012b). “State updating of a distributed hydrological model with ensemble Kalman filtering: Effects of updating frequency and observation network density on forecast accuracy.” Hydrol. Earth Syst. Sci., 16(9), 3435–3449.
Reichle, R., Entekhabi, D., and McLaughlin, D-B. (2001a). “Downscaling of radio brightness measurements for soil moisture estimation: A fourdimensional variational data assimilation approach.” Water Resour. Res., 37(9), 2353–2364.
Reichle, R., McLaughlin, D. B., and Entekhabi, D. (2001b). “Variational data assimilation of microwave radiobrightness observations for land surface hydrology applications.” IEEE Trans. Geosci. Remote Sens., 39(8), 1708–1718.
Reichle, R., Walker, J. P., Koster, R. D., and Houser, P.-R. (2002). “Extended versus ensemble Kalman filtering for land data assimilation.” J. Hydrometeorol., 3(6), 728–740.
Restrepo, P. J. (1985). “A view of maximum-likelihood estimation with large conceptual hydrologic models.” Appl. Math. Comput., 17(4), 375–403.
Seiller, G., Anctil, F., and Perrin, C. (2012). “Multimodel evaluation of twenty lumped hydrological models under contrasted climate conditions.” Hydrol. Earth Syst. Sci., 16(4), 1171–1189.
Senbeta, D. A., Shamseldin, A. Y., and O’Connor, K. M. (1999). “Modification of the probabilitydistributed interacting storage capacity model.” J. Hydrol., 224(3–4), 149–168.
Seo, D. J., Cajina, L., Corby, R., and Howieson, T. (2009). “Automatic state updating for operational streamflow forecasting via variational data assimilation.” J. Hydrol., 367(3–4), 255–275.
Seo, D. J., Koren, V., and Cajina, N. (2003). “Real-time variational assimilation of hydrologic and hydrometeorological data into operational hydrologic forecasting.” J. Hydrometeorol., 4(3), 627–641.
Stroud, J. R., Lesht, B. M., Schwab, D. J., Beletsky, D., and Stein, M. L. (2009). “Assimilation of satellite images into a sediment transport model of Lake Michigan.” Water Resour. Res., 45(2), W02419.
Thirel, G., et al. (2010b). “A past discharge assimilation system for ensemble streamflow forecasts over France. Part 2: Impact on the ensemble streamflow forecasts.” Hydrol. Earth Syst. Sci., 14(8), 1639–1653.
Thirel, G., Martin, E., Mahfouf, J.-F., Massart, S., Ricci, S., and Habets, F. (2010a). “A past discharges assimilation system for ensemble streamflow forecasts over France—Part 1: Description and validation of the assimilation system.” Hydrol. Earth Syst. Sci., 14(8), 1623–1637.
Tippett, M. K., Anderson, J. L., Bishop, C. H., Hamill, T. M., and Whitaker, J. S. (2003). “Ensemble square root filters.” Mon. Weather Rev., 131(7), 1485–1490.
Valéry, A. (2010). “Modélisation précipitations – débit sous influence nivale, Elaboration d’un module neige et évaluation sur 380 bassins versants.” Ph.D. thesis, Agro Paris Tech, Paris, France (in French).
Valstar, J. R., McLaughlin, D. B., Stroet, C. B. M. Te., and Van Geer, F. C. (2004). “A representer-based inverse method for groundwater flow and transport applications.” Water Resour. Res., 40(5), W05116.
Vrugt, J. A., Diks, C. G. H., Gupta, H. V., Bouten, W., and Verstraten, J. M. (2005). “Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation.” Water Resour. Res., 41(1), W01017.
Vrugt, J. A., ter Brakk, C. J. F., Diks, C. G. H., and Schoups, G. (2013). “Hydrologic data assimilation using particle Markov chain Monte carlo simulation: Theory, concepts and applications.” Adv. Water Resour., 51(0), 457–478.
Weerts, A. H., and El Serafy, G. Y. H. (2006). “Particle filtering and ensemble Kalman filtering for state updating with hydrological conceptual rainfall-runoff models.” Water Resour. Res., 42(9), W09403.
Weerts, A. H., Seo, D.-J., Werner, M., and Schaake, J. (2012). “Operational hydrologic ensemble forecasting.” Applied uncertainty analysis for flood risk management, K. Beven and J. Hall, eds., Imperial College Press, London.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 20 • Issue 2 • February 2015
Copyright
© 2014 American Society of Civil Engineers.
History
Received: May 11, 2013
Accepted: Apr 25, 2014
Published online: Jul 25, 2014
Discussion open until: Dec 25, 2014
Published in print: Feb 1, 2015
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.