Association Journal of CSIAM
Supervised by Ministry of Education of PRC
Sponsored by Xi'an Jiaotong University
ISSN 1005-3085  CN 61-1269/O1

Chinese Journal of Engineering Mathematics ›› 2019, Vol. 36 ›› Issue (2): 123-137.doi: 10.3969/j.issn.1005-3085.2019.02.001

    Next Articles

A Descent Alternating Direction Method of Multipliers with Random Step Size for Structured Optimization Problem

ZHANG Yan-na1,    SHEN Yuan1,   SUN Li-ming2   

  1. 1- School of Applied Mathematics, Nanjing University of Finance & Economics, Nanjing 210023
    2- School of Statistics and Mathematics Science, Nanjing Audit University, Nanjing 211815
  • Received:2017-03-31 Accepted:2018-05-04 Online:2019-04-15 Published:2019-06-15
  • Contact: L. Sun. E-mail address: lmsun@nau.edu.cn
  • Supported by:
    The National Natural Science Foundation of China (11401295; 11726618); the National Social Science Foundation of China (15BGL158; 17BTQ063); the Qinglan Project of Jiangsu Province; the Social Science Foundation of Jiangsu Province (18GLA002); the Natural Science Foundation of University and Colleges in Jiangsu Province (18KJB110016).

Abstract: In this paper, we consider the structured convex optimization problem with two blocks of variables. The alternating direction method of multipliers (ADMM) is a classical method for solving this problem, which is based on the augmented Lagrange algorithm and it utilizes the separability of two blocks of variables in the objective function to simplify the computation of subproblems. The descent alternating direction method of multipliers (DADMM) is an improved version of ADMM, which applies an optimal step as well as a fixed factor to do extension on  part of the variables. The DADMM is reported to be faster than the classical ADMM in numerical simulations. According to the idea of SC-Method proposed by Xu which allows the extension factor to be randomly generated, we propose a new DADMM with random step size. The convergence of the new algorithm can be derived under mild assumptions. Preliminary experiments demonstrate the promising performance and dimensional scalability of the new method.

Key words: variational inequalities, alternating direction method of multipliers, proximal point algorithm, random step size, structured optimization

CLC Number: