科学与工程计算系列讨论班—A New First-order Framework for Orthogonal Constrained Optimization Problems
主 题: 科学与工程计算系列讨论班—A New First-order Framework for Orthogonal Constrained Optimization Problems
报告人: 刘歆 副研究员 (中科院计算数学研究所)
时 间: 2017-04-20 10:30-11:30
地 点: 理科1号楼1303
Abstract: In this talk, we consider
a class of orthogonal
constrained optimization
problems, the feasible region of which is called the Stiefel manifold. Our new proposed framework combines a function value reduction step with a multiplier correction step. Different with the existing approaches, the function value reduction is conducted in the Euclidean space instead of the Stiefel manifold or its tangent space. We construct two types of algorithms based on! this new framework. The first type is gradient reduction based algorithms which consists of gradient reflection (GR) and gradient projection (GP) two implementations. The other one adopts a column-wise block coordinate descent (CBCD) scheme with a novel idea for solving the corresponding CBCD subproblem inexactly. Theoretically, we can prove that both GR/GP with a fixed stepsize and CBCD belong to our framework, and any clustering point of the iterates generated by the proposed framework is a first-order stationary point. Preliminary experiments illustrate that our new framework is of great potential.
