Status of Automatic Calibration for Hydrologic Models: Comparison with Multilevel Expert Calibration
Publication: Journal of Hydrologic Engineering
Volume 4, Issue 2
Abstract
The usefulness of a hydrologic model depends on how well the model is calibrated. Therefore, the calibration procedure must be conducted carefully to maximize the reliability of the model. In general, manual procedures for calibration can be extremely time-consuming and frustrating, and this has been a major factor inhibiting the widespread use of the more sophisticated and complex hydrologic models. A global optimization algorithm entitled shuffled complex evolution recently was developed that has proved to be consistent, effective, and efficient in locating the globally optimal model parameters of a hydrologic model. In this paper, the capability of the shuffled complex evolution automatic procedure is compared with the interactive multilevel calibration multistage semiautomated method developed for calibration of the Sacramento soil moisture accounting streamflow forecasting model of the U.S. National Weather Service. The results suggest that the state of the art in automatic calibration now can be expected to perform with a level of skill approaching that of a well-trained hydrologist. This enables the hydrologist to take advantage of the power of automated methods to obtain good parameter estimates that are consistent with the historical data and to then use personal judgment to refine these estimates and account for other factors and knowledge not incorporated easily into the automated procedure. The analysis also suggests that simple split-sample testing of model performance is not capable of reliably indicating the existence of model divergence and that more robust performance evaluation criteria are needed.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Beven, K. J., and Binley, A. M. ( 1992). “The future of distributed models: Model calibration and uncertainty prediction.” Hydrological Processes, Sussex, U.K., 6, 279–298.
2.
Bonan, G. B. ( 1996). “Sensitivity of a GCM simulation to subgrid infiltration and surface runoff.” Climate Dyn., 12, 279–285.
3.
Boughton, W. C. ( 1965). “A new estimation technique for estimation of catchment yield.” Rep. No. 78, Water Resources Laboratory, University of New South Wales, Manly Vale.
4.
Brazil, L. E. ( 1988). “Multilevel calibration strategy for complex hydrologic simulation models,” PhD dissertation, Colorado State University, Fort Collins, Colo.
5.
Brazil, L. E., and Hudlow, M. D. ( 1981). Calibration procedures used with the National Weather Service river forecast system, in water and related land resource systems . New York, 457–466.
6.
Brazil, L. E., and Krajewski, W. F. ( 1987). “Optimization of complex hydrologic models using random search methods.” Conf. on Engrg. Hydro., Hydraulics Division, ASCE, New York, 726–731.
7.
Chapman, T. G. ( 1970). “Optimization of a rainfall-runoff model for an arid zone catchment.” UNESCO Publication 96, United Nations Educational, Scientific, and Cultural Organization, Wallington, New Zealand.
8.
Dawdy, D. R., and O'Donnell, T. (1965). “Mathematical models of catchment behavior.”J. Hydr. Div., ASCE, 91(4), 113–137.
9.
Duan, Q. Y., Gupta, V. K., and Sorooshian, S. ( 1992). “Effective and efficient global optimization for conceptual rainfall-runoff models.” Water Resour. Res., 28(4), 1015–1031.
10.
Duan, Q. Y., Gupta, V. K., and Sorooshian, S. ( 1993). “A shuffled complex evolution approach for effective and efficient global minimization.” J. Optimization Theory and Applications, 76(3), 501–521.
11.
Duan, Q. Y., Sorooshian, S., and Gupta, V. K. ( 1994). “Optimal use of the SCE-UA global optimization method for calibrating watershed models.” J. Hydro., Amsterdam, 158, 265–284.
12.
Freer, J., Beven, K. J., and Ambroise, B. ( 1996). “Bayesian estimation of uncertainty in runoff prediction and the value of data: An application of the GLUE approach.” Water Resour. Res., 32(7), 2161–2173.
13.
Gan, T. Y., and Biftu, G. F. ( 1996). “Automatic calibration of conceptual rainfall-runoff models: Optimization algorithms, catchment conditions and model structure.” Water Resour. Res., 32(12), 3513–3524.
14.
Gupta, V. K., and Sorooshian, S. ( 1985). “The relationship between data and the precision of parameter estimates of hydrologic models.” J. Hydro., Amsterdam, 81, 57–77.
15.
Ibbitt, R. P. ( 1970). “Systematic parameter fitting for conceptual models of catchment hydrology,” PhD dissertation, University of London, London.
16.
Ibbitt, R. P., and Hutchinson, P. D. ( 1984). “Model parameter consistency and fitting criteria.” Proc., IFAC 9th Triennial World Congr., International Federation of Automatic Control, 153–157.
17.
Ibbitt, R. P., and O'Donnell, T. (1971). “Fitting methods for conceptual catchment models.”J. Hydr. Div., ASCE, 97(9), 1331–1342.
18.
James, L. D., and Burges, S. J. ( 1982). “Selection, calibration, and testing of hydrologic models.” Hydrologic testing of small watersheds, C. T. Haan, H. P. Johnson, and D. L. Brakensiek, eds., American Society of Agricultural Engineers, St. Joseph, Mich., 435–472.
19.
Johnston, P. R., and Pilgrim, D. ( 1976). “Parameter optimization for watershed models.” Water Resour. Res., 12(3), 477–486.
20.
Jones, D. A. ( 1983). “Statistical analysis of empirical models fitted by optimization.” Biometrika, 70(1), 67–88.
21.
Keesman, K. J. ( 1990). “Set-theoretic parameter estimation using random scanning and principal component analysis.” Math. Computation and Simulation, 32, 535–543.
22.
Klepper, O., Scholten, H., and Kamer, J. P. G. v. d. ( 1991). “Prediction uncertainty in an ecological model of the Oosterschelde Estuary.” J. Forecasting, 10, 191–209.
23.
Kuczera, G. ( 1982). “On the relationship of the reliability of parameter estimates and hydrologic time series data used in calibration.” Water Resour. Res., 18(1), 146–154.
24.
Kuczera, G. ( 1983a). “Improved parameter inference in catchment models: 1. Evaluating parameter uncertainty.” Water Resour. Res., 19(5), 1151–1162.
25.
Kuczera, G. ( 1983b). “Improved parameter inference in catchment models: 2. Combining different kinds of hydrologic data and testing their compatibility.” Water Resour. Res., 19(5), 1163–1172.
26.
Kuczera, G. ( 1988). “On validity of first-order prediction limits for conceptual hydrological models.” J. Hydro., Amsterdam, 103, 229–247.
27.
Kuczera, G. ( 1997). “Efficient subspace probabilistic parameter optimization for catchment models.” Water Resour. Res., 33(1), 177–185.
28.
Lemmer, H. R., and Rao, A. R. ( 1983). “Critical duration analysis and parameter estimation in ILLUDAS.” Tech. Rep. No. 153, Water Resources Research Center, Purdue University, West Lafayette, Ind.
29.
Luce, C. H., and Cundy, T. W. ( 1994). “Parameter identification for a runoff model for forest roads.” Water Resour. Res., 30(4), 1057–1069.
30.
Monro, J. C. ( 1971). “Direct search optimization in mathematical modeling and a watershed model application.” NOAA Techn. Memo No. NWS HYDRO-12, U.S. Department of Commerce, Silver Spring, Md.
31.
Mroczkowski, M., Raper, G. P., and Kuczera, G. ( 1997). “The quest for more powerful validation of conceptual catchment models.” Water Resour. Res., 33(10), 2325–2336.
32.
Nash, J. E., and Sutcliffe, J. V. ( 1970). “River flow forecasting through conceptual models, Part 1—a discussion of principles.” J. Hydro., Amsterdam, 10(3), 282–290.
33.
Nelder, J. A., and Mead, R. ( 1965). “A simplex method for function minimization.” Computer J., 7(4), 308–313.
34.
Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. ( 1992). Numerical recipes in C: The art of scientific computing . Cambridge University Press, Cambridge, London.
35.
Sefe, F. T., and Boughton, W. C. ( 1982). “Variation of model parameter values and sensitivity with type of objective function.” J. Hydro. (New Zealand), 21(1), 117–132.
36.
Sorooshian, S., and Dracup, J. A. ( 1980). “Stochastic parameter estimation procedures for hydrologic rainfall-runoff models: Correlated and heteroscedastic error cases.” Water Resour. Res., 16(2), 430–442.
37.
Sorooshian, S., Duan, Q. Y., and Gupta, V. K. ( 1993). “Calibration of rainfall-runoff models: Application of global optimization to the Sacramento soil moisture accounting model.” Water Resour. Res., 29(4), 1185–1194.
38.
Sorooshian, S., and Gupta, V. K. ( 1983). “Automatic calibration of conceptual rainfall-runoff models: The question of parameter observability and uniqueness.” Water Resour. Res., 19(1), 260–268.
39.
Sorooshian, S., Gupta, V. K., and Fulton, J. L. ( 1981). “Parameter estimation of conceptual rainfall-runoff models assuming autocorrelated data errors—a case study.” Int. Symp. on Rainfall-Runoff Modeling, Mississippi State, Miss., 491–504.
40.
Sorooshian, S., Gupta, V. K., and Fulton, J. L. ( 1983). “Evaluation of maximum likelihood parameter estimation techniques for conceptual rainfall-runoff models: Influence of calibration data variability and length on model credibility.” Water Resour. Res., 19(1), 251–259.
41.
Spear, R. C., and Hornberger, G. M. ( 1980). “Eutrophication in Peel Inlet—II. Identification of critical uncertainties via generalized sensitivity analysis.” Water Resour. Res., 14, 43–49.
42.
Tanakamaru, H. ( 1995). “Parameter estimation for the tank model using global optimization.” Trans. JSIDRE, 178, 103–112.
43.
Tanakamaru, H., and Burges, S. J. ( 1996). “Application of global optimization to parameter estimation of the tank model.” Proc., Int. Conf. on Water Resour. and Envir. Res.: Towards the 21st Century, 39–46.
44.
van Straten, G., and Keesman, K. J. ( 1991). “Uncertainty propagation and speculation in projective forecasts of environmental change: A lake-eutrophication example.” J. Forecasting, 10, 163–190.
45.
Wang, Q. J. ( 1991). “The genetic algorithm and its application to calibrating conceptual rainfall-runoff models.” Water Resour. Res., 27(9), 2467–2471.
46.
Yapo, P. O., Gupta, H. V., and Sorooshian, S. ( 1996). “Automatic calibration of conceptual rainfall-runoff models: Sensitivity to calibration data.” J. Hydro., 181, 23–48.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 4 • Issue 2 • April 1999
Pages: 135 - 143
History
Received: Jun 23, 1997
Published online: Apr 1, 1999
Published in print: Apr 1999
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.