Convergence rate analysis for the higher order power method in best rank one approximations of tensors

Guoyin Li University of New South Wales Shenglong Hu Hangzhou Dianzi University

Numerical Analysis and Scientific Computing Optimization and Control mathscidoc:1904.25003

Numerische Mathematik, 140, 993–1031, 2018
A popular and classical method for finding the best rank one approximation of a real tensor is the higher order power method (HOPM). It is known in the literature that the iterative sequence generated by HOPM converges globally, while the convergence rate can be superlinear, linear or sublinear. In this paper, we examine the convergence rate of HOPM in solving the best rank one approximation problem of real tensors. We first show that the iterative sequence of HOPM always converges globally and provide an explicit eventual sublinear convergence rate. The sublinear convergence rate estimate is in terms of the dimension and the order of the underlying tensor space. Then, we examine the concept of nondegenerate singular vector tuples and show that, if the sequence of HOPM converges to a nondegenerate singular vector tuple, then the global convergence rate is R-linear. We show that, for almost all tensors (in the sense of Lebesgue measure), all the singular vector tuples are nondegenerate, and so, the HOPM “typically” exhibits global R-linear convergence rate. Moreover, without any regularity assumption, we establish that the sequence generated by HOPM always converges globally and R-linearly for orthogonally decomposable tensors with order at least 3. We achieved this by showing that each nonzero singular vector tuple of an orthogonally decomposable tensor with order at least 3 is nondegenerate.
tensors, high order power method, best rank one approximations
[ Download ] [ 2019-04-14 19:55:42 uploaded by gyli ] [ 844 downloads ] [ 0 comments ]
@inproceedings{guoyin2018convergence,
  title={Convergence rate analysis for the higher order power method in best rank one approximations of tensors},
  author={Guoyin Li, and Shenglong Hu},
  url={http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20190414195542707085237},
  booktitle={Numerische Mathematik},
  volume={140},
  pages={993–1031},
  year={2018},
}
Guoyin Li, and Shenglong Hu. Convergence rate analysis for the higher order power method in best rank one approximations of tensors. 2018. Vol. 140. In Numerische Mathematik. pp.993–1031. http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20190414195542707085237.
Please log in for comment!
 
 
Contact us: office-iccm@tsinghua.edu.cn | Copyright Reserved