Validation of Knowledge‐Based System with Multiple Bridge Rail Experts
Publication: Journal of Transportation Engineering
Volume 120, Issue 5
Abstract
A procedure is described that can be used to validate a knowledge‐based expert system. The method applies four qualitative measures that are specially designed for problems solved by multiple levels of experts whose authority and expertise can be modeled hierarchically. Development of test cases and performance measures are discussed. The proposed method is applied to a system that selects and ranks bridge rails from a list of candidate configurations. This rule‐based system aids engineers in selecting bridge rails according to conditions of the roadway, bridge, and surrounding environment. Based on the level of agreement with human experts and the Turing test, it is shown that the prototype system exhibits a relatively high level of expertise. Other tests and observations indicate that some system deficiencies exist and several features need modification and refinement.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Buchanan, B., et al. (1983). “Constructing an expert system.” Building expert systems, F. Hayes‐Roth, D. Waterman, and D. Lenat, eds., Addison‐Wesley, Reading, Mass.
2.
Culbert, C., Riley, G., and Savely, R. T. (1987). “Approaches to the verification of rule‐based systems.” SOAR Conf., NASA/JSC, Houston, Tex.
3.
Geismann, J., and Schultz, R. (1988). “Verification and validation of expert systems.” AI Expert, 3(2), 26–33.
4.
Guide specifications for bridge railings. (1989). American Association of State Highway and Transportation Officials (AASHTO), Washington, D.C.
5.
Marcot, B. (1987). “Testing your knowledge base.” AI Expert, 2(8), 42–47.
6.
Mitri, W. A. (1991). “Validation of expert systems with multiple experts,” MS thesis, Texas A&M University, College Station, Tex.
7.
NEXPERT OBJECT programmer's reference manual. (1991). Neuron Data, Inc., Palo Alto, Calif.
8.
O'Keefe, M., Osman, B., and Smith, P. (1987). “Validating expert system performance.” IEEE Expert, 4(2), 81–89.
9.
O'Leary, D. (1987). “Validation of expert systems—with applications to auditing and accounting systems.” Decision Sci., 18(3), 468–486.
10.
Roschke, P., Premthamkorn, P., Mitri, W., and Wang, B. (1990). “Knowledge‐based system for bridge rail design.” Rep. No. 1240‐2F, Texas Transportation Institute, Texas A&M Univ., College Station, Tex.
11.
Ross, H., and Sicking, D. (1984). “Benefit cost analysis of roadside safety alternatives.” Transp. Res. Record 1065, Transportation Research Board, Washington, D.C., 98–105.
12.
Turing, A. (1963). “Computer machinery and intelligence.” Comp. and thought, A. Feigenbaum and J. Feldman, eds., McGraw‐Hill, New York, N.Y.
Information & Authors
Information
Published In
Journal of Transportation Engineering
Volume 120 • Issue 5 • September 1994
Pages: 787 - 806
Copyright
Copyright © 1994 American Society of Civil Engineers.
History
Received: Jul 22, 1992
Published online: Sep 1, 1994
Published in print: Sep 1994
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.