Technical Papers
Apr 3, 2013

3σ-Rule for Outlier Detection from the Viewpoint of Geodetic Adjustment

Publication: Journal of Surveying Engineering
Volume 139, Issue 4

Abstract

The so-called 3σ-rule is a simple and widely used heuristic for outlier detection. This term is a generic term of some statistical hypothesis tests whose test statistics are known as normalized or studentized residuals. The conditions, under which this rule is statistically substantiated, were analyzed, and the extent it applies to geodetic least-squares adjustment was investigated. Then, the efficiency or nonefficiency of this method was analyzed and demonstrated on the example of repeated observations.

Get full access to this article

View all available purchase options and get full access to this article.

References

Abdi, H. (2007). “The Bonferroni and Šidák corrections for multiple comparisons.” Encyclopedia of measurement and statistics, N. Salkind, ed., Sage, Thousand Oaks, CA.
Anscombe, F. J. (1960). “Rejection of outliers.” Technometrics, 2(2), 123–147.
Baarda, W. (1968). “A testing procedure for use in geodetic networks.” Publications on geodesy 9, 2(5), Netherlands Geodetic Commission, Delft, Netherlands.
Baselga, S. (2007). “Critical limitation in use of τ test for gross error detection.” J. Surv. Eng., 133(2), 52–55.
Baselga, S. (2011). “Nonexistence of rigorous tests for multiple outlier detection in least-squares adjustment.” J. Surv. Eng., 137(3), 109–112.
Featherstone, W. E., and Morgan, L. (2007). “Validation of the AUSGeoid98 model in Western Australia using historic astrogeodetically observed deviations of the vertical.” J. R. Soc. West. Aust., 90(3), 143–150.
Grubbs, F. E. (1969). “Procedures for detecting outlying observations in samples.” Technometrics, 11(1), 1–21.
Hampel, F. R., Ronchetti, E. M., Roussseeuw, P. R., and Stahel, W. A. (1986). Robust statistics, Wiley, New York.
Hawkins, D. (1980). Identification of outliers, Chapman and Hall, London.
Heck, B. (1981). “Der Einfluß einzelner Beobachtungen auf das Ergebnis einer Ausgleichung und die Suche nach Ausreißern in den Beobachtungen.” Allgemeine Vermessungsnachrichten, 01, 17–34 (in German).
Hekimoglu, S., Erdogan, B., and Erenoglu, R. C. (2012). “A new outlier detection method considering outliers as model errors.” Exp. Tech., 10.1111/j.1747-1567.2012.00876.x.
Hekimoglu, S., and Koch, K. R. (2000). “How can reliability of the test for outliers be measured?” Allgemeine Vermessungsnachrichten, 7, 247–253.
Huber, P. J. (1981). Robust statistics, Wiley, New York.
Kargoll, B. (2012). On the theory and application of model misspecification tests in geodesy, Series C, Vol. 674, German Geodetic Commission, Munich, Germany.
Koch, K. R. (1999). Parameter estimation and hypothesis testing in linear models, Springer, Berlin.
Kutterer, H., Heinkelmann, R., and Tesmer, V. (2003). “Robust outlier detection in VLBI data analysis.” Proc., 16th Working Meeting on European VLBI for Geodesy and Astrometry, W. Schwegmann and V. Thorandt, eds., Bundesamt für Kartographie und Geodäsie, Leipzig/Frankfurt am Main, Germany, 247–255.
Lehmann, E. L., and Romano, J. P. (2005). Testing statistical hypotheses, 3rd Ed., Springer, New York.
Lehmann, R. (2010). “Normierte Verbesserungen - wie groß ist zu groß?” Allgemeine Vermessungs-nachrichten, 2, 53–61 (in German).
Lehmann, R. (2012a). “Geodätische Fehlerrechnung mit der skalenkontaminierten Normalverteilung.” Allgemeine Vermessungsnachrichten, 119(5), 143–149 (in German).
Lehmann, R. (2012b). “Improved critical values for extreme normalized and studentized residuals in Gauss-Markov models.” J. Geod., 86(12), 1137–1146.
Lehmann, R. (2013). “On the formulation of the alternative hypothesis for geodetic outlier detection.” J. Geod., 87(4), 373–386.
Lehmann, R., and Scheffler, T. (2011). “Monte Carlo based data snooping with application to a geodetic network.” J. Appl. Geod., 5(3–4), 123–134.
Microsoft Excel [Computer software]. Redmond, WA, Microsoft.
Neitzel, F. (2004). Identifizierung konsistenter Datengruppen am Beispiel der Kongruenzuntersuchung geodätischer Netze, Series C, Vol. 565, German Geodetic Commission, Munich, Germany.
Pope, A. J. (1976). “The statistics of residuals and the detection of outliers.” NOAA Technical Rep. NOS65 NGS1, U.S. Dept. of Commerce, National Geodetic Survey, Rockville, MD.
Rousseeuw, P. J., and Leroy, A. M. (1987). Robust regression and outlier detection, Wiley, New York.
Teunissen, P. J. G. (2000). “Testing theory; an introduction.” Series on mathematical geodesy and positioning, 2nd Ed., Delft Univ. of Technology, Delft, Netherlands.
van Loon, J. P. (2008). “Functional and stochastic modelling of satellite gravity data.” Publications on geodesy 67, Netherlands Geodetic Commission, Delft, Netherlands.
van Mierlo, J. (1983). “Problems of computing costs in decision problems.” Mathematical models of geodetic/photogrammetric point determination with regard to outliers and systematic errors, Series A, F. E. Ackermann, ed., Vol. 98, German Geodetic Commission, Munich, Germany.
Wilcox, R. R. (2012). Introduction to robust estimation and hypothesis testing, Academic Press, Waltham, MA.
Xu, P. L. (2005). “Sign-constrained robust least squares, subjective breakdown point and the effect of weights of observations on robustness.” J. Geodesy, Berlin, 79(1–3), 146–159.

Information & Authors

Information

Published In

Go to Journal of Surveying Engineering
Journal of Surveying Engineering
Volume 139Issue 4November 2013
Pages: 157 - 165

History

Received: Nov 21, 2012
Accepted: Apr 1, 2013
Published online: Apr 3, 2013
Published in print: Nov 1, 2013

Permissions

Request permissions for this article.

Authors

Affiliations

Rüdiger Lehmann [email protected]
Professor, Univ. of Applied Sciences Dresden, Faculty of Spatial Information, Friedrich-List-Platz 1, D-01069 Dresden, Germany. E-mail: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited by

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share