Testing, Verification, and Validation of Expert Systems
Publication: Journal of Transportation Engineering
Volume 117, Issue 3
Abstract
This paper discusses how an expert system can be tested, verified, and validated. A prototype expert system, the Hazardous Location Analyst (HLA), which analyzes high‐accident locations, is used to illustrate the evaluation process and to examine the various aspects of testing, verification, and validation. Identified were several key issues that must be addressed when evaluating an expert system: problem complexity, no “correct answers,” the problem of defining expert‐level performance, and considerations in knowledge‐base refinement. The paper also suggests ways in which to make comparisons between expert‐system and human‐expert inferences so that ease of use, knowledge‐base adequacy, and completeness may be examined. The paper further suggests that although some quantitative performance measures are useful for the evaluation process, a qualitative evaluation is perhaps also appropriate for many aspects of these kinds of systems.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Agent, K. R. (1983). Warrants at left turn lanes. TQ Eno Foundation, Westport, Conn.
2.
Akbar, M. F., and Layton, R. D. (1986). “Accident experience of flashing traffic signal operations in Portland.” Transp. Res. Record 1069, Transp. Res. Board, Washington, D.C.
3.
Briglea, P. M., Jr. (1982). “An evaluation of four‐way stop sign control.” ITE J., 52(8), 16–19.
4.
Clancey, W. (1987). Knowledge‐based tutoring: The GUIDON program. The MIT Press, Cambridge, Mass.
5.
Dym, C. (1987). “Implementation issues in the building of expert systems.” Expert systems for civil engineers; Technology and application. ASCE, New York, N.Y., 35–45.
6.
Feigenbaum, E. A., Barr, A., and Cohen, P. R. (1982). The handbook of artificial intelligence. William Kaufman, Inc., Los Altos, Calif., Vols. 1–3.
7.
Gaberty, M. J., and Barbaresso, J. C. (1987). “A case study of the accident impacts of flashing signal operations.” ITE J., 57(7), 27–28.
8.
Hayes‐Roth, F., Waterman, D. A., and Lenat, D. B. (1983). Building experts systems. Addison Wesley Publishing Company, Inc., Reading, Mass.
9.
International Conf. on Applications of Advanced Technologies in Transp. Engrg.; Session on Expert System Implementation Issues. (1989). ASCE, New York, N.Y.
10.
Janoff, M. S., and Hill, J. G. (1986). “Effectiveness of flashing beacons in reducing accidents at a hazardous rural curve.” Transp. Res. Record 1069, Transp. Res. Board, Washington, D.C.
11.
Lovell, J., and Hauer, E. (1986). “The safety effect of conversion to all‐way stop control.” Transp. Res. Record 1069, Transp. Res. Board, Washington, D.C.
12.
Maher, M. L. (1987). Expert systems for civil engineers: Technology and application. ASCE, New York, N.Y.
13.
Parsaye, K., and Cignell, M. (1988). Expert systems for experts. John Wiley and Sons, New York, N.Y.
14.
Piaget, J. (1970). Science of education and the psychology of the child, translated by D. Coltman, Viking, New York, N.Y.
15.
Ritchie, S. G. (1987). “Expert systems in transportation engienering.” Expert systems for civil engineers: Technology and application. ASCE, New York, N.Y., 129–143.
16.
Spring, G. S., Collura, J., and Shuldiner, P. W. (1987). “Analysis of high hazard locations: Is an expert system approach feasible?” Transp. Res. Record 1111, Transp. Res. Board, Washington, D.C.
17.
Spring, G. S. (1988). “An expert system to analyze hazardous intersections.” Microcomputers in Civ. Engrg., 3(4), 299–309.
18.
Spring, G. S. (1989). “The testing and validation of expert systems: A discussion of some major issues,” Proc., ASCE Int. Conf. on Applications of Advanced Technologies in Transp. Engrg., ASCE, New York, N.Y.
19.
Waterman, D. A. (1986). A guide to expert systems. Addison‐Wesley Publishing Co., Reading, Mass.
20.
Weiss, S. M., and Kulikowski, C. A. (1984). A practical guide to designing expert systems. Rowman and Allanheld, Totowa, N.J.
Information & Authors
Information
Published In
Journal of Transportation Engineering
Volume 117 • Issue 3 • May 1991
Pages: 350 - 360
Copyright
Copyright © 1991 ASCE.
History
Published online: May 1, 1991
Published in print: May 1991
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.