Technical Papers
Jun 16, 2023

Multivariate Weighted Total Least Squares Based on the Standard Least-Squares Theory

Publication: Journal of Surveying Engineering
Volume 149, Issue 4

Abstract

The weighted total least squares (WTLS) has been widely used in many geodetic problems to solve the error-in-variable (EIV) models in which both the observation vector and the design matrix contain random errors. This method is widely applied in its univariate form, where the observations and unknown coefficients appear in vector forms. However, in some geodetic problems, data sets appear in more than one dimension, and the vector representation of the univariate model may not be suitable to efficiently solve the problem. The observation and unknown parameter vectors can then be replaced with their counterparts in matrix representations in a multivariate model. In this paper, we propose a simple, fast, and flexible procedure for solving the multivariate WTLS (MWTLS) problem using the standard least squares theory. The method has the capability of applying to large-size and high-dimensional data sets. Our numerical experiments on both simulated and real datasets demonstrate the high performance of the proposed method for solving multivariate WTLS problems. In terms of computational complexity, our method outperforms the existing state-of-the-art methods, both numerically and analytically.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

Some or all data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request. The available data are: (1) generating synthetic data, and (2) MATLAB code for MWTLS.

References

Akyilmaz, O. 2007. “Total least squares solution of coordinate transformation.” Surv. Rev. 39 (303): 68–80. https://doi.org/10.1179/003962607X165005.
Amiri-Simkooei, A. 2007. “Least-squares variance component estimation: Theory and GPS applications.” Ph.D. thesis, Dept. of Mathematical Geodesy and Positioning, Delft Univ. of Technology.
Amiri-Simkooei, A., and S. Jazaeri. 2012. “Weighted total least squares formulated by standard least squares theory.” J. Geodetic Sci. 2 (2): 113–124. https://doi.org/10.2478/v10156-011-0036-5.
Amiri-Simkooei, A. R. 2013. “Application of least squares variance component estimation to errors-in-variables models.” J. Geod. 87 (10–12): 935–944. https://doi.org/10.1007/s00190-013-0658-8.
Amiri-Simkooei, A. R. 2017. “Weighted total least squares with singular covariance matrices subject to weighted and hard constraints.” J. Surv. Eng. 143 (4): 04017018. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000239.
Amiri-Simkooei, A. R. 2018a. “Parameter estimation in 3D affine and similarity transformation: Implementation of variance component estimation.” J. Geod. 92 (11): 1285–1297. https://doi.org/10.1007/s00190-018-1119-1.
Amiri-Simkooei, A. R. 2018b. “Weighted total least squares with constraints: Alternative derivation without using Lagrange multipliers.” J. Surv. Eng. 144 (2): 06017005. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000253.
Amiri-Simkooei, A. R., S. Mortazavi, and J. Asgari. 2016a. “Weighted total least squares applied to mixed observation model.” Surv. Rev. 48 (349): 278–286. https://doi.org/10.1179/1752270615Y.0000000031.
Amiri-Simkooei, A. R., F. Zangeneh-Nejad, and J. Asgari. 2016b. “On the covariance matrix of weighted total least-squares estimates.” J. Surv. Eng. 142 (3): 04015014. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000153.
Fang, X. 2011. “Weighted total least squares solutions for applications in geodesy.” Ph.D. thesis, Dept. of Geodesy and Geoinformatics, Gottfried Wilhelm Leibniz Universität Hannover.
Fang, X. 2013. “A structured and constrained total least-squares solution with cross-covariances.” Stud. Geophys. Geod. 58 (1): 1–16. https://doi.org/10.1007/s11200-012-0671-z.
Fang, X. 2014. “On noncombinatorial weighted total least squares with inequality constraints.” J. Geod. 88 (8): 805–816. https://doi.org/10.1007/s00190-014-0723-y.
Felus, Y. A. 2004. “Application of total least squares for spatial point process analysis.” J. Surv. Eng. 130 (3): 126–133. https://doi.org/10.1061/(ASCE)0733-9453(2004)130:3(126).
Felus, Y. A., and R. C. Burtch. 2008. “On symmetrical three-dimensional datum conversion.” GPS Solutions 13 (1): 65–74. https://doi.org/10.1007/s10291-008-0100-5.
Golub, G. H., and C. F. Van Loan. 1980. “An analysis of the total least squares problem.” SIAM J. Numer. Anal. 17 (6): 883–893. https://doi.org/10.1137/0717073.
Jazaeri, S., A. R. Amiri-Simkooei, and M. A. Sharifi. 2013. “Iterative algorithm for weighted total least squares adjustment.” Surv. Rev. 46 (334): 19–27. https://doi.org/10.1179/1752270613Y.0000000052.
Kariminejad, M. M., M. A. Sharifi, and A. R. Amiri-Simkooei. 2021. “Tikhonov-regularized weighted total least squares formulation with applications to geodetic problems.” Acta Geod. Geophys. 57 (1): 23–42. https://doi.org/10.1007/s40328-021-00365-1.
Khazraei, S. M., and A. R. Amiri-Simkooei. 2019. “On the application of Monte Carlo singular spectrum analysis to GPS position time series.” J. Geod. 93 (9): 1401–1418. https://doi.org/10.1007/s00190-019-01253-x.
Neitzel, F. 2010. “Generalization of total least-squares on example of unweighted and weighted 2D similarity transformation.” J. Geod. 84 (12): 751–762. https://doi.org/10.1007/s00190-010-0408-0.
Schaffrin, B. 2006. “A note on constrained total least-squares estimation.” Linear Algebra Appl. 417 (1): 245–258. https://doi.org/10.1016/j.laa.2006.03.044.
Schaffrin, B., and Y. A. Felus. 2008. “On the multivariate total least-squares approach to empirical coordinate transformations. Three algorithms.” J. Geod. 82 (6): 373–383. https://doi.org/10.1007/s00190-007-0186-5.
Schaffrin, B., and A. Wieser. 2007. “On weighted total least-squares adjustment for linear regression.” J. Geod. 82 (7): 415–421. https://doi.org/10.1007/s00190-007-0190-9.
Schaffrin, B., and A. Wieser. 2009. “Empirical affine reference frame transformations by weighted multivariate TLS adjustment.” In Geodetic reference frames, 213–218. New York: Springer.
Shen, Y., B. Li, and Y. Chen. 2010. “An iterative solution of weighted total least-squares adjustment.” J. Geod. 85 (4): 229–238. https://doi.org/10.1007/s00190-010-0431-1.
Sima, D. M., S. V. Huffel, and G. H. Golub. 2004. “Regularized total least squares based on quadratic eigenvalue problem solvers.” BIT Numer. Math. 44 (4): 793–812. https://doi.org/10.1007/s10543-004-6024-8.
Teunissen, P. J. G. 2000. Adjustment theory: An introduction. Delft, Netherlands: Delft University Press.
Wang, J., W. Yan, Q. Zhang, and L. Chen. 2021. “Enhancement of computational efficiency for weighted total least squares.” J. Surv. Eng. 147 (4): 04021019. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000373.
Wang, L., and X. Luo. 2023. “Adaptive two-stage Monte Carlo algorithm for accuracy estimation of total least squares.” J. Surv. Eng. 149 (1): 04022012. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000408.
Wang, L., and Y. Zhao. 2019. “Second-order approximation function method for precision estimation of total least squares.” J. Surv. Eng. 145 (1): 04018011. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000266.
Wang, L., Y. Zhao, X. Chen, and D. Zang. 2016. “A Newton algorithm for multivariate total least squares problems.” Acta Geod. Cartographica Sin. 45 (4): 411. https://doi.org/10.11947/j.AGCS.2016.20150246.
Wang, Q., Y. Hu, and B. Wang. 2019. “The maximum likelihood estimation for multivariate EIV model.” Acta Geod. Geophys. 54 (2): 213–224. https://doi.org/10.1007/s40328-019-00253-9.
Zhou, Y., and X. Fang. 2016. “A mixed weighted least squares and weighted total least squares adjustment method and its geodetic applications.” Surv. Rev. 48 (351): 421–429. https://doi.org/10.1179/1752270615Y.0000000040.

Information & Authors

Information

Published In

Go to Journal of Surveying Engineering
Journal of Surveying Engineering
Volume 149Issue 4November 2023

History

Received: Nov 14, 2022
Accepted: Apr 13, 2023
Published online: Jun 16, 2023
Published in print: Nov 1, 2023
Discussion open until: Nov 16, 2023

Permissions

Request permissions for this article.

Authors

Affiliations

Postdoctoral Researcher, Dept. of Geomatics Engineering, Faculty of Civil Engineering and Transportation, Univ. of Isfahan, Isfahan 8174673441, Iran (corresponding author). ORCID: https://orcid.org/0000-0002-3081-7949. Email: [email protected]
Assistant Professor, Dept. of Geoscience and Remote Sensing, Faculty of Civil Engineering and Geosciences, Delft Univ. of Technology, Delft 2628 CN, Netherlands. ORCID: https://orcid.org/0000-0002-2952-0160. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share