Association Journal of CSIAM
Supervised by Ministry of Education of PRC
Sponsored by Xi'an Jiaotong University
ISSN 1005-3085  CN 61-1269/O1

Chinese Journal of Engineering Mathematics ›› 2025, Vol. 42 ›› Issue (3): 509-528.doi: 10.3969/j.issn.1005-3085.2025.03.008

Previous Articles     Next Articles

Federated Learning Algorithm Based on Newton's Method under the Partial Participation Scheme

CAO Zilong,   GUO Xiao,   ZHANG Hai   

  1. School of Mathematics, Northwest University, Xi'an 710127
  • Received:2022-10-15 Accepted:2023-03-29 Online:2025-06-15 Published:2025-06-15
  • Supported by:
    The National Natural Science Foundation of China--Big Data Major Project of Guangdong Province (U1811461).

Abstract:

Federated learning is a new distributed learning framework to deal with data isolation and privacy protection. This paper focuses on the second-order gradient federated learning algorithm. It carries out the research on the federated learning Newton's algorithm for the more practical scheme that only some users can participate in the federated learning task. The convergence of the algorithm is proved theoretically. By using the McDiarmid inequality, the trade-off of the number of participating users, the convergence speed of the algorithm and the final convergence error are theoretically explained. The experimental results show that the algorithm can converge quickly and efficiently, effectively reduce the communication cost of federated learning, and prove the effectiveness, practicality and theoretical correctness of the algorithm.

Key words: federated learning, Newton's method, convergence, distributed computing, communication effectiveness

CLC Number: