Computational Procedure for Evaluating Sampling Techniques on Watershed Model Calibration
Publication: Journal of Hydrologic Engineering
Volume 20, Issue 7
Abstract
A variety of computational techniques have been developed to efficiently and effectively draw realizations from the parameter space of watershed models for parameter estimation. However, to date, it has not been clearly understood how these techniques should be evaluated side by side. The main goal of this study is to develop and demonstrate a computational procedure for evaluating parameter sampling techniques. The analysis hinges on the evaluation of (1) efficiency in minimizing objective functions at the lowest required realizations; (2) effectiveness in drawing samples that adequately represent watershed characteristics based on automatic calibration results, and (3) effectiveness in enhancing the identifiability of the effective parameter space. The proposed procedure was applied to evaluate the performance of six commonly implemented sampling techniques for multisite, multiresponse parameter estimation of a river basin scale model in the Eagle Creek Watershed, Indiana, in the Midwestern United States. Results show that a particular technique surpassed all other methods in convergence speed and behavioral statistics. In addition, solutions derived using that technique were distributed closely in relatively small regions of the whole domain space, which enhanced the efficiency of the parameter search process.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This study was supported in part by the USDA–National Institute of Food and Agriculture Grants 2007-51130-03876 and 2009-51130-06038 and the Research Program for Agricultural Science & Technology Development (Project No. PJ008566), National Academy of Agricultural Science, Rural Development Administration, Republic of Korea. Constructive comments by the associate editor and two anonymous reviewers greatly improved the quality of the paper.
References
Ajami, N. K., Duan, Q., and Sorooshian, S. (2007). “An integrated hydrologic Bayesian multimodel combination framework: Confronting input, parameter, and model structural uncertainty in hydrologic prediction.” Water Resour. Res., 43, 1–19.
Beck, M. B., et al. (2002). “Developing a concept of adaptive community learning: Case study of a rapidly urbanizing watershed.” Integr. Assess., 3(4), 299–307.
Behrangi, A., Khakbaz, B., Vrugt, J. A., Duan, Q., and Sorooshian, S. (2008). “Comment on ‘Dynamically dimensioned search algorithm for computationally efficient watershed model calibration’ by Bryan A. Tolson and Christine A. Shoemaker.” Water Resour. Res., 44, W12603.
Beven, K., and Binley, A. (1992). “The future of distributed models: Model calibration and uncertainty prediction.” Hydrol. Processes, 6(3), 279–298.
Beven, K., Smith, P. J., and Freer, J. (2008). “So just why would a modeller choose to be incoherent.” J. Hydrol., 354(1), 15–32.
Cassidy, R., and Jordan, P. (2011). “Limitations of instantaneous water quality sampling in surface-water catchments: Comparison with near-continuous phosphorus time-series data.” J. Hydrol., 405(1–2), 182–193.
Daggupati, P., Douglas-Mankin, K. R., Sheshukov, A. Y., Barnes, P. L., and Devlin, D. L. (2011). “Field-level targeting using SWAT: Mapping output from HRUs to fields and assessing limitations of GIS input data.” Trans. ASABE, 54(2), 501–514.
Duan, Q., Gupta, V. K., and Sorooshian, S. (1993). “Shuffled complex evolution approach for effective and efficient global minimization.” J. Optim. Theory Appl., 76(3), 501–521.
Duan, Q., Sorooshian, S., and Gupta, V. K. (1992). “Effective and efficient global optimization for conceptual rainfall-runoff models.” Water Resour. Res., 28(4), 1015–1031.
Emery, X. (2007). “Using the Gibbs sampler for conditional simulation of Gaussian-based random fields.” Comput. Geosci., 33(4), 522–537.
Gassman, P. W., Reyes, M. R., Green, C. H., and Arnold, J. G. (2007). “The soil and water assessment tool: Historical development, applications, and future research directions.” Trans. ASABE, 50(4), 1211–1250.
Gelman, A., and Rubin, D. B. (1992). “Inference from iterative simulation using multiple sequences.” Stat. Sci., 7(4), 457–472.
Geman, S., and Geman, D. (1984). “Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images.” IEEE Trans. Pattern Anal. Mach. Intell., PAMI-6(6), 721–741.
Haario, H., Laine, M., Mira, A., and Saksman, E. (2006). “DRAM: Efficient adaptive MCMC.” Stat. Comput., 16(4), 339–354.
Haario, H., Laine, M., Saksman, E., and Tamminen, J. (2001). “An adaptive Metropolis algorithm.” Bernoulli, 7(2), 223–242.
Haario, H., Saksman, E., and Tamminen, J. (1999). “Adaptive proposal distribution for random walk Metropolis algorithm.” Comput. Stat., 14(3), 375–395.
Harmel, R. D., Cooper, R., Slade, R., Haney, R., and Arnold, J. (2006). “Cumulative uncertainty in measured streamflow and water quality data for small watersheds.” Trans. ASABE, 49(3), 689–701.
Hastings, W. K. (1970). “Monte Carlo sampling methods using Markov chains and their applications.” Biometrika, 57(1), 97–109.
Hendrix, E. M. T., and Klepper, O. (2000). “On uniform covering, adaptive random search and raspberries.” J. Global Optim., 18(2), 143–163.
Holland, J. H. (1975). Adaptation in natural and artificial systems, University of Michigan Press, Ann Arbor, MI.
Homer, C., Huang, C., Yang, L., Wylie, B., and Coan, M. (2004). “Development of a 2001 national land-cover database for the United States.” Photogramm. Eng. Remote Sens., 70(7), 829–840.
Hoque, Y. M., Hantush, M. M., and Govindaraju, R. S. (2014). “On the scaling behavior of reliability-resilience-vulnerability indices in agricultural watersheds.” Ecol. Indic., 40, 136–146.
Kirchner, J. W. (2006). “Getting the right answers for the right reasons: Linking measurements, analyses, and models to advance the science of hydrology.” Water Resour. Res., 42, W03S04.
Klepper, O., and Bedaux, J. J. M. (1997). “A robust method for nonlinear parameter estimation illustrated on a toxicological model.” Nonlinear Anal. Theory Methods Appl., 30(3), 1677–1686.
Klepper, O., and Hendrix, E. M. T. (1994). “A method for robust calibration of ecological models under different types of uncertainty.” Ecol. Modell., 74(3–4), 161–182.
Kottegoda, N. T., Natale, L., and Raiteri, E. (2007). “Gibbs sampling of climatic trends and periodicities.” J. Hydrol., 339(1–2), 54–64.
Laloy, E., and Vrugt, J. A. (2012). “High-dimensional posterior exploration of hydrologic models using multiple-try and high-performance computing.” Water Resour. Res., 48, W01526.
Marshall, L., Nott, D., and Sharma, A. (2004). “A comparative study of Markov chain Monte Carlo methods for conceptual rainfall-runoff modeling.” Water Resour. Res., 40, W02501.
McMillan, H., and Clark, M. (2009). “Rainfall-runoff model calibration using informal likelihood measures within a Markov chain Monte Carlo sampling scheme.” Water Resour. Res., 45, W04418.
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953). “Equations of state calculations by fast computing machines.” J. Chem. Phys., 21(6), 1087–1092.
Michalak, A. M. (2008). “A Gibbs sampler for inequality-constrained geostatistical interpolation and inverse modeling.” Water Resour. Res., 44, W09437.
Moriasi, D. N., Arnold, J. G., Liew, M. W. V., Bingner, R. L., Harmel, R. D., and Veith, T. L. (2007). “Model evaluation guidelines for systematic quantification of accuracy in watershed simulations.” Am. Soc. Agric. Biol. Eng., 50(3), 885–900.
Muttil, N., and Jayawardena, A. W. (2008). “Shuffled complex evolution model calibrating algorithm: Enhancing its robustness and efficiency.” Hydrol. Processes, 22(23), 4628–4638.
Nelder, J. A., and Mead, R. (1965). “A simplex method for function minimization.” Comput. J., 7(4), 308–313.
Newman, J. E. (1997). “Our changing climate.” The natural heritage of Indiana, M. T. Jackson, ed., Indiana University Press, Bloomington, IN, 85–99.
Onibon, H., Lebel, T., Afouda, A., and Guillot, G. (2004). “Gibbs sampling for conditional spatial disaggregation of rain fields.” Water Resour. Res., 40, W08401.
Osidele, O. O., Zeng, W., and Beck, M. B. (2003). “Coping with uncertainty: A case study in sediment transport and nutrient load analysis.” J. Water Resour. Plann. Manage., 345–355.
Osidele, O. O., Zeng, W., and Beck, M. B. (2006). “A random search methodology for examining parametric uncertainty in water quality models.” Water Sci. Technol., 53(1), 33–40.
Osorio, J., Jeong, J., Arnold, J. G., and Beiger, B. (2014). “Influence of potential evapotranspiration on the water balance of sugarcane fields in Maui, Hawaii.” J. Water Res. Prot., 6, 852–868.
Price, W. L. (1987). “Global optimization algorithms for a CAD workstation.” J. Optim. Theory Appl., 55(1), 133–146.
Seo, M.-J., Yen, H., and Jeong, J. (2014). “Transferability of input parameters between SWAT 2009 and SWAT 2012.” J. Environ. Qual., 43, 869–880.
Sorooshian, S., Duan, Q., and Gupta, V. K. (1993). “Calibration of rainfall-runoff models: Application of global optimization to the Sacramento soil moisture accounting model.” Water Resour. Res., 29(4), 1185–1194.
Spear, R. C., Grieb, T. M., and Shang, N. (1994). “Parameter uncertainty and interaction complex environmental models.” Water Resour. Res., 30(11), 3159–3169.
Stedinger, J. R., Vogel, R. M., Lee, S. U., and Batchelder, R. (2008). “Appraisal of the generalized likelihood uncertainty estimation (GLUE) method.” Water Resour. Res., 44, W00B06.
Ter Braak, C. (2006). “A Markov Chain Monte Carlo version of the genetic algorithm differential evolution: Easy Bayesian computing for real parameter spaces.” Stat. Comput., 16(3), 239–249.
Thyer, M., Renard, B., Kavetski, D., Kuczera, G., Franks, S. W., and Srikanthan, S. (2009). “Critical evaluation of parameter consistency and predictive uncertainty in hydrological modeling: A case study using Bayesian total error analysis.” Water Resour. Res., 45, W00B14.
Tolson, B. A., and Shoemaker, C. A. (2007). “Dynamically dimensioned search algorithm for computationally efficient watershed model calibration.” Water Resour. Res., 43, W01413.
Tolson, B. A., and Shoemaker, C. A. (2008). “Reply to comment on ‘Dynamically dimensioned search algorithm for computationally efficient watershed model calibration’ by Ali Behrangi et al.” Water Resour. Res., 44, W12604.
Van Griensven, A., and Meixner, T. (2007). “A global and efficient multi-objective auto-calibration and uncertainty estimation method for water quality catchment models.” J. Hydroinf., 9(4), 277–291.
Vrugt, J. A. (2011). “DREAM(D): An adaptive Markov chain Monte Carlo simulation algorithm to solve discrete, noncontinuous, posterior parameter estimation problems.” Hydrol. Earth Syst. Sci., 8(2), 4025–4052.
Vrugt, J. A., Braak, C. J. F., Clark, M. P., Hyman, J. M., and Robinson, B. A. (2008). “Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation.” Water Resour. Res., 44, W00B09.
Vrugt, J. A., Braak, C. J. F., Diks, C. G. H., Robinson, B. A., Hyman, J. M., and Higdon, D. (2009). “Accelerating Markov chain Monte Carlo simulation by differential evolution with self-adaptive randomized subspace sampling.” Int. J. Nonlinear Sci. Numer. Simul., 10(3), 271–288.
Vrugt, J. A., Gupta, H. V., Bouten, W., and Sorooshian, S. (2003). “A shuffled complex evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters.” Water Resour. Res., 39(8), 1201.
Walsh, B. (2004). “Markov chain Monte Carlo and Gibbs sampling.” Lecture notes for EEB 581, version 26, 〈http://web.mit.edu/~wingated/www/introductions/mcmc-gibbs-intro.pdf〉.
Wang, D., Singh, V. P., Zhu, Y., and Wu, J. (2009). “Stochastic observation error and uncertainty in water quality evaluation.” Adv. Water Resour., 32(10), 1526–1534.
Yang, J., Reichert, P., Abbaspour, K. C., Xia, J., and Yang, H. (2008). “Comparing uncertainty analysis techniques for a SWAT application to the Chaohe basin in China.” J. Hydrol., 358(1–2), 1–23.
Yen, H. (2012). “Confronting input, parameter, structural and measurement uncertainty in multi-site multiple responses watershed modeling using Bayesian inferences.” Ph.D. dissertation, Colorado State Univ., Fort Collins, CO.
Yen, H., Ahmadi, M., White, M. J., Wang, X., and Arnold, J. G. (2014a). “C-SWAT: The soil and water assessment tool with consolidated input files in alleviating computational burden of recursive simulations.” Comput. Geosci., 72, 221–232.
Yen, H., Bailey, R. T., Arabi, M., Ahmadi, M., White, M. J., and Arnold, J. G. (2014b). “The role of interior watershed processes in improving parameter estimation and performance of watershed models.” J. Environ. Qual., 43(5), 1601–1613.
Yen, H., Wang, X., Fontane, D. G., Harmel, R. D., and Arabi, M. (2014c). “A framework for propagation of uncertainty contributed by input data, parameterization, model structure, and calibration/validation data in watershed modeling.” Environ. Modell. Softw., 54, 211–221.
Yen, H., White, M. J., Arabi, M., and Arnold, J. G. (2014d). “Evaluation of alternative surface runoff accounting procedures using the SWAT model.” Int. J. Agric. Biol. Eng., in press.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 20 • Issue 7 • July 2015
Copyright
© 2014 American Society of Civil Engineers.
History
Received: May 29, 2013
Accepted: Aug 27, 2014
Published online: Oct 17, 2014
Discussion open until: Mar 17, 2015
Published in print: Jul 1, 2015
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.