Sensitivity Analysis of Computer Models: World Bank HDM-III Model
Publication: Journal of Transportation Engineering
Volume 125, Issue 5
Abstract
A problem often arising in engineering applications of computer models is to determine the importance of each data item in the large pool of required input factors. This paper explores a statistical approach for investigating factor sensitivities. The methodology is demonstrated with the HDM-III highway life-cycle cost analysis model. Specifically, the net present value (NPV) of life-cycle costs predicted by the HDM-III model is analyzed, and sensitivities of NPV to the link characterization input factors are investigated. In the statistically designed experiment, combinations of the input factors are chosen using a method called Latin hypercube sampling, which is well suited to the deterministic HDM-III model. Two analyses of the output data are performed, based on a first-order regression approximation and a Gaussian stochastic-process model. For NPV, the factor rankings are similar, but the sensitivities obtained from the two techniques show some marked differences. This demonstrates the greater flexibility of the stochastic-process model in dealing with nonlinearities and factor interactions in complex input-output relationships.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Ashley, D. J. ( 1980). “Uncertainty in the context of highway appraisal.” Transportation, 9(3), 249–267.
2.
Aslett, R., Buck, R. J., Duvall, S. G., Sacks, J., and Welch, W. J. (1998). “Circuit optimization via sequential computer experiments: Design of an output buffer.” Appl. Statistics, 47(1), 31–48.
3.
Box, G. E. P., Hunter, W. G., and Hunter, J. S. (1978). Statistics for experimenters. Wiley, New York.
4.
Chesher, A., and Harrison, R. (1987). Vehicle operating costs: Evidence from developing countries. Johns Hopkins University Press, Baltimore.
5.
Cundill, M. A., and Withnall, S. J. (1995). “Road transport investment model RTIM3.” Proc., 6th Int. Conf. on Low-Vol. Roads, Vol. 1, Transportation Research Board, Washington, D.C., 187–190.
6.
Currin, C., Mitchell, T., Morris, M., and Ylvisaker, D. (1991). “Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments.” J. Am. Statistical Assn., 86, 953–963.
7.
Haas, R., Hudson, W. R., and Zaniewski, J. (1994). Modern pavement management. Krieger Publishing Co., Malabar, Fla.
8.
Haas, R., Karan, M. A., Cheetham, A., and Khalil, S. (1985). “Pavement rehabilitation programming: A range of options.” Proc., North Am. Pavement Mgmt. Conf., Vol. 2, 6.41–6.54.
9.
HDM-PC: The highway design and maintenance standards model: User's guide and PC disks, version 2.0. (1989). World Bank, Washington, D.C.
10.
He, Z., Kennepohl, G., Haas, R., and Cai, Y. (1996). “OPAC 2000: A new pavement design system.” Proc., Transp. Assn. of Canada Annu. Conf.
11.
Howard, K. R., Robertson, N. F., and Francisco, R. (1994). “Introduction of investment analysis into pavement management practices in the Philippines.” Proc., 3rd. Int. Conf. on Managing Pavements, Vol. 1, Transportation Research Board, Washington, D.C., 267–277.
12.
Iman, R. L., and Conover, W. J. (1982). “A distribution-free approach to inducing rank correlation among input variables.” Communications in Statistics Part B: Simulation and Computation, 11(3), 311–334.
13.
Kerali, H. R., Snaith, M. S., and Koole, R. C. (1991). “Economic viability of upgrading low-volume roads.” Transp. Res. Rec. 1291, Vol. 1, Transportation Research Board, Washington, D.C., 34–40.
14.
Liebman, J. S. (1985). “Optimization tools for pavement management.” Proc., North Am. Pavement Mgmt. Conf., Vol. 2, 6.5–6.15.
15.
Little, I. M. D., and Mirrlees, J. A. (1974). Project appraisal and planning for developing countries. Heinemann, London.
16.
McKay, M. D., Conover, W. J., and Beckman, R. J. (1979). “A comparison of three methods for selecting values of input variables in the analysis of output from a computer code.” Technometrics, 21(2), 239–245.
17.
Mrawira, D. ( 1996). “Streamlining the World Bank's highway design and maintenance standards model (HDM-III) for network level application.” PhD thesis, University of Waterloo, Waterloo, Canada.
18.
Mrawira, D., and Haas, R. (1996). “Toward adapting HDM-III model to local conditions: Lessons from a case study in Tanzania.” Transp. Res. Rec. 1524, Transportation Research Board, Washington, D.C., 58–66.
19.
Paterson, W. D. O. (1987). Road deterioration and maintenance effects: Models for planning and management. Johns Hopkins University Press, Baltimore.
20.
Queiroz, C., Fonseca, V. M. R., and dos Santos, A. B. (1991). “Economic appraisal of Guinea-Bissau roads program using HDM-III and EBM models.” Transp. Res. Rec. 1291, Vol. 1, Transportation Research Board, Washington, D.C., 105–115.
21.
Queiroz, C., Hudson, W. R., and Haas, R. (1992). “Standardization of pavement management systems in Brazil and other development countries.” Transp. Res. Rec. 1344, Transportation Research Board, Washington, D.C., 31–37.
22.
Road deterioration in developing countries: Causes and remedies. (1988). World Bank, Washington, D.C.
23.
Robertson, N. F., and Charmala, R. (1994). “Applications of HDM-III to road upkeep investment studies in Queensland.” Proc., Int. Workshop on HDM-4, Vol. 1, 95–112.
24.
Sacks, J., Welch, W. J., Mitchell, T. J., and Wynn, H. P. (1989). “Design and analysis of computer experiments (with discussion).” Statistical Sci., 4(4), 409–435.
25.
Watanatada, T., Harral, C. G., Paterson, W. D. O., Dhareshwar, A. M., Bhandari, A., and Tsunokawa, K. (1987). The highway design and maintenance standards model, Vol. 1: Description of the HDM-III model. Johns Hopkins University Press, Baltimore.
26.
Welch, W. J., Buck, R. J., Sacks, J., Wynn, H. P., Mitchell, T. J., and Morris, M. D. (1992). “Screening, predicting, and computer experiments.” Technometrics, 34(1), 15–25.
Information & Authors
Information
Published In
Journal of Transportation Engineering
Volume 125 • Issue 5 • September 1999
Pages: 421 - 428
History
Received: Mar 2, 1998
Published online: Sep 1, 1999
Published in print: Sep 1999
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.