Using Panel Data Analysis to Estimate DEA Confidence Intervals Adjusted for the Environment
Publication: Journal of Transportation Engineering
Volume 134, Issue 5
Abstract
This paper illustrates three concepts new to the data envelopment analysis (DEA) literature, and applies them to data from Canadian paratransit agencies. First, it predicts valid confidence intervals and trends for each agency’s true efficiency. Second, it uses panel data analysis methodology, a set of statistical procedures that are more likely to produce valid estimates than those commonly used in DEA studies. Third, it uses a new method of identifying and adjusting for environmental effects that has more power than conventional procedures.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The writers sincerely thank an anonymous referee, who clearly has substantial acumen about paratransit operations, data envelopment analysis and the transit literature using it, and panel data analysis. The paper is much improved due to the referee’s suggestions.
References
Andersen, P., and Petersen, N. C. (1993). “A procedure for ranking efficient units in data envelopment analysis.” Manage. Sci., 39(10), 1261–1265.
Baltagi, B. H. (2005). Econometric analysis of panel data, Wiley, West Sussex, U.K.
Barnum, D. T., and Gleason, J. M. (2005). “Technical efficiency bias caused by intra-input aggregation in data envelopment analysis.” Appl. Econ. Lett., 12(13), 785–788.
Barnum, D. T., and Gleason, J. M. (2006a). “Biases in technical efficiency scores caused by intra-input aggregation: Mathematical analysis and a DEA application using simulated data.” Appl. Econom., 38, 1593–1603.
Barnum, D. T., and Gleason, J. M. (2006b). “Measuring efficiency in allocating inputs among outputs with DEA.” Appl. Econ. Lett., 13(6), 333–336.
Barnum, D. T., and Gleason, J. M. (2007a). “Bias and precision in the DEA two-stage method.” Appl. Econom., in press.
Barnum, D. T., and Gleason, J. M. (2007b). “Estimating data envelopment analysis frontiers for nonsubstitutable inputs and outputs.” Great Cities Institute Working Paper GCP-08-03, ⟨http://www.uic.edu/cuppa/gci/publications/workingpaperseries/pdfs/GCP-08-03_Darold_Barnum.pdf⟩.
Barnum, D. T., and Gleason, J. M. (2007c). “Technical efficiency bias in data envelopment analysis caused by intra-output aggregation.” Appl. Econ. Lett., 14(9), 623–626.
Barnum, D. T., Gleason, J. M., and Hemily, B. (2007a). “Estimating confidence intervals for DEA scores with panel data analysis.” Appl. Econom., in press.
Barnum, D. T., McNeil, S., and Hart, J. (2007b). “Comparing the efficiency of public transportation subunits using data envelopment analysis.” J. Public Trans., 10(2), 1–16.
Barnum, D. T., Tandon, S., and McNeil, S. (2007c). “Comparing the performance of bus routes after adjusting for the environment, using Data Envelopment Analysis.” J. Transp. Eng., 134(2), 77–85.
Baum, C. F. (2006). An introduction to modern econometrics using Stata, Stata Press, College Station, Tex.
Benn, H. P. (1995). Bus route evaluation standards, transit cooperative research program, synthesis of transit practice 10, National Academies, Washington, D.C.
Boame, A. K. (2004). “The technical efficiency of Canadian urban transit systems.” Transp. Res. Part E, 40(5), 401–416.
Boilé, M. P. (2001). “Estimating technical and scale inefficiencies of public transit systems.” J. Transp. Eng., 127(3), 187–194.
Breen, R. (1996). Regression models: Censored, sample-selected, or truncated data, Sage, Thousand Oaks, Calif.
Brons, M., Nijkamp, P., Pels, E., and Rietveld, P. (2005). “Efficiency of urban public transit: A meta analysis.” Transportation, 32(1), 1–21.
Button, K., and Costa, A. (1999). “Economic efficiency gains from urban public transport regulatory reform: Two case studies of changes in Europe.” Ann. Reg. Sci., 33(4), 425–438.
Canadian Urban Transit Association. (1996–2004). Specialized transit services fact books: 1996–2004 operating data, Canadian Urban Transit Association, Toronto.
Chang, K. P., and Kao, P. H. (1992). “The relative efficiency of public versus private municipal bus firms: An application of data envelopment analysis.” J. Prod. Anal., 3, 67–84.
Charnes, A., Cooper, W. W., and Rhodes, E. (1978). “Measuring the efficiency of decision making units.” Eur. J. Oper. Res., 2(6), 429–444.
Chu, X., Fielding, G. J., and Lamar, B. W. (1992). “Measuring transit performance using data envelopment analysis.” Transp. Res., Part A: Policy Pract., 26(3), 223–230.
Coelli, T. J., Rao, D. S. P., O’Donnell, C. J., and Battese, G. E. (2005). An introduction to efficiency and productivity analysis, Springer, New York.
Cooper, W. W., Seiford, L. M., and Zhu, J. (2004a). “Data envelopment analysis: History, models and interpretations.” Handbook on data envelopment analysis, W. W. Cooper, L. M. Seiford, and J. Zhu, eds., Kluwer Academic, Boston, 1–40.
Cooper, W. W., Seiford, L. M., and Zhu, J. (2004b). Handbook on data envelopment analysis, Kluwer, Academic, Boston.
Danchenko, D. (2006). Public transportation fact book, ⟨http://www.apta.com/research/stats/factbook/documents/2006factbook.pdf⟩ (May 24, 2006).
De Borger, B., Kerstens, K., and Costa, A. (2002). “Public transit performance: What does one learn from frontier studies?” Transport Rev., 22(1), 1–38.
Färe, R., and Grosskopf, S. (2004). New directions: Efficiency and productivity, Kluwer Academic, Boston.
Färe, R., Grosskopf, S., and Lovell, C. A. K. (1994). Production frontiers, Cambridge University Press, Cambridge, U.K.
Färe, R., Grosskopf, S., and Zelenyuk, V. (2004). “Aggregation bias and its bounds in measuring technical efficiency.” Appl. Econ. Lett., 11(10), 657–660.
Färe, R., and Zelenyuk, V. (2002). “Input aggregation and technical efficiency.” Appl. Econ. Lett., 9(10), 635–636.
Frees, E. W. (1995). “Assessing cross-sectional correlation in panel data.” J. Econometr., 69(2), 393–414.
Frees, E. W. (2004). Longitudinal and panel data: Analysis and applications in the social sciences, Cambridge University Press, Cambridge, U.K.
Fu, L., Casello, J. M., and Yang, J. (2007). “Quantifying technical efficiency of paratransit systems using data envelopment analysis method.” Transportation Research Record., in press.
Gleason, J. M., and Barnum, D. T. (1982). “Toward valid measures of public sector productivity: Performance indicators in urban transit.” Manage. Sci., 28(4), 379–386.
Gong, B. H., and Sickles, R. C. (1992). “Finite-sample evidence on the performance of stochastic frontiers and data envelopment analysis using panel data.” J. Econometr., 51(1–2), 259–284.
Graham, D. J. (2006). “Productivity and efficiency in urban railways: Parametric and non-parametric estimates.” Transportation Research Part E: Logistics and Transportation Review, in press.
Grosskopf, S. (1996). “Statistical inference and nonparametric efficiency: A selective survey.” J. Prod. Anal., 7(2–3), 161–176.
Hemily, B. (2004). “Trends affecting public transit’s effective-ness.” ⟨http://www.apta.com/government_affairs/policy/trends_affecting.cfm⟩ (Oct. 10, 2005).
Holland, D. S., and Lee, S. T. (2002). “Impacts of random noise and specification on estimates of capacity derived from data envelopment analysis.” Eur. J. Oper. Res., 137(1), 10–21.
Hsiao, C. (2003). Analysis of panel data, Cambridge University Press, Cambridge, U.K.
Karlaftis, M. G. (2003). “Investigating transit production and performance: A programming approach.” Transp. Res., Part A: Policy Pract., 37(3), 225–240.
Karlaftis, M. G. (2004). “A DEA approach for evaluating the efficiency and effectiveness of urban transit systems.” Eur. J. Oper. Res., 152(2), 354–364.
Kerstens, K. (1996). “Technical efficiency measurement and explanation of French urban transit companies.” Transp. Res., Part A: Policy Pract., 30(6), 431–452.
Kittelson Associates, Urbitran, LKC Consulting Services, MORPACE International, Queensland University of Technology, and Nakanishi, Y. (2003). “A guidebook for developing a transit performance-measurement system.” Transit Cooperative Research Program Rep. No. 88, Transportation Research Board, Washington, D.C.
Kumbhakar, S., and Lovell, C. A. K. (2000). Stochastic frontier analysis, Cambridge University Press, Cambridge, U.K.
Lin, J., Wang, P., and Barnum, D. T. (2007). “A quality control framework for bus schedule reliability.” Transportation Research E: Logistics and Transportation Review, in press.
Litman, T. (2004). “Transit price elasticities and cross-elasticities.” J. Public Trans., 7(2), 37–58.
Mahlberg, B., and Url, T. (2003). “Effects of the single market on the Austrian insurance industry.” Empirical Econ., 28(4), 813–838.
Nolan, J. F. (1996). “Determinants of productive efficiency in urban transit.” Logistics Transp. Rev., 32(3), 319–342.
Nolan, J. F., Ritchie, P. C., and Rowcroft, J. R. (2001). “Measuring efficiency in the public sector using nonparametric frontier estimators: A study of transit agencies in the USA.” Appl. Econom., 33(7), 913–922.
Nolan, J. F., Ritchie, P. C., and Rowcroft, J. E. (2002). “Identifying and measuring public policy goals: ISTEA and the US bus transit industry.” J. Econ. Behav. Organ., 48(3), 291–304.
Novaes, A. G. N. (2001). “Rapid transit efficiency analysis with the assurance-region DEA method.” Pesqui Operacional, 21(2), 179–197.
Odeck, J. (2006). “Congestion, ownership, region of operation, and scale: Their impact on bus operator performance in Norway.” Socio-Econ. Plan. Sci., 40(1), 52–69.
Odeck, J., and Alkadi, A. (2001). “Evaluating efficiency in the Norwegian bus industry using data envelopment analysis.” Transportation, 28(3), 211–232.
Petersen, N. C. (1990). “Data envelopment analysis on a relaxed set of assumptions.” Manage. Sci., 36(3), 305–314.
Pina, V., and Torres, L. (2001). “Analysis of the efficiency of local government services delivery: An application to urban public transport.” Transp. Res., Part A: Policy Pract., 35(10), 929–944.
Ray, S. C. (2004). Data envelopment analysis: Theory and techniques for economics and operations research, Cambridge University Press, Cambridge, U.K.
Ruggiero, J. (2004). “Data envelopment analysis with stochastic data.” J. Oper. Res. Soc., 55(9), 1008–1012.
Scheel, H. (2000). “EMS: Efficiency measurement system.” ⟨http://www.wiso.uni-dortmund.de/lsfg/or/scheel/ems/⟩ (Dec. 17, 2000).
Sengupta, J. K. (1998a). “Stochastic data envelopment analysis: A new approach.” Appl. Econ. Lett., 5, 287–290.
Sengupta, J. K. (1998b). “Testing allocative efficiency by data envelopment analysis.” Appl. Econ. Lett., 5(11), 689–692.
Sheth, C., Triantis, K., and Teodorovic, D. (2006). “Performance evaluation of bus routes: A provider and passenger perspective.” Transp. Res. Part E, in press.
Simar, L., and Wilson, P. W. (2004). “Performance of the bootstrap for DEA estimators and iterating the principle.” Handbook on data envelopment analysis, W. W. Cooper, L. M. Seiford, and J. Zhu, eds., Kluwer, Boston, 265–298.
Simar, L., and Wilson, P. W. (2007). “Estimation and inference in two-stage, semi-parametric models of production processes.” J. Econometr., 136(1), 31–64.
Smerk, G. M. (1974). Urban mass transportation: A dozen years of Federal policy, Indiana University Press, Bloomington, Ind.
Smerk, G. M. (1991). The federal role in urban mass transportation, Indiana University Press, Bloomington, Ind.
Smerk, G. M., and Gerty, R. B. (1988). Mass transit management: A handbook for small cities, Urban Mass Transportation Administration, Washington, D.C.
StataCorp. (2007). Stata statistical software, Release 9.2, College Station, Tex.
Steinmann, L., and Zweifel, P. (2003). “On the (in)efficiency of Swiss hospitals.” Appl. Econom., 35(3), 361–370.
Tauer, L. W. (2001). “Input aggregation and computed technical efficiency.” Appl. Econ. Lett., 8(5), 295–297.
Transit Cooperative Research Program. (2006). Guidebook for measuring, assessing, and improving performance of demand-response Transportation, ⟨http://www4.trb.org/trb/crp.nsf/All+Projects/TCRP+B-31⟩.
Viton, P. A. (1997). “Technical efficiency in multi-mode bus transit: A production frontier analysis.” Transp. Res., Part B: Methodol., 31(1), 23–39.
Vuchic, V. R. (2004). Urban transit: Operations, planning, and economics, Wiley, New York.
Washington, S., Karlaftis, M. G., and Mannering, F. L. (2003). Statistical and econometric methods for transportation data analysis, Chapman & Hall/CRC, Boca Raton, Fla.
Wooldridge, J. M. (2002). Econometric analysis of cross section and panel data, MIT Press, Cambridge, Mass.
Xue, M., and Harker, P. T. (1999). “Overcoming the inherent dependency of DEA efficiency scores: A bootstrap approach, 99-17.” Financial Institutions Center, Wharton School, Univ. of Pennsylvania, Philadelphia, ⟨http://fic.wharton.upenn.edu/fic/papers/99/9917.pdf⟩.
Yang, J. (2005). “Quantifying the technical efficiency of Canadian paratransit systems using data envelopment analysis method.” Master of Applied Science in Civil Engineering, Univ. of Waterloo, Waterloo, Ont., Canada.
Yu, M. M. (2007). “Measuring the efficiency and return to scale status of multi-mode bus transit-evidence from Taiwan’s bus system.” Appl. Econ. Lett., in press.
Zelenyuk, V. (2005). “Power of significance test of dummies in Simar-Wilson two-stage efficiency analysis model, DP0522.” Institut de Statistique, Univ. Catholique de Louvain, Belgium, ⟨http://www.stat.ucl.ac.be/ISpub/ISdp.html#2005⟩.
Information & Authors
Information
Published In
Journal of Transportation Engineering
Volume 134 • Issue 5 • May 2008
Pages: 215 - 223
Copyright
© 2008 ASCE.
History
Received: Mar 27, 2007
Accepted: Oct 29, 2007
Published online: May 1, 2008
Published in print: May 2008
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.