Association Journal of CSIAM
Supervised by Ministry of Education of PRC
Sponsored by Xi'an Jiaotong University
ISSN 1005-3085  CN 61-1269/O1

Chinese Journal of Engineering Mathematics ›› 2017, Vol. 34 ›› Issue (2): 209-220.doi: 10.3969/j.issn.1005-3085.2017.02.009

Previous Articles    

The Generalization Ability of Online Algorithm for $\alpha$-mixing Sequence

HU Xiao-yun1,   ZOU Bin1,   GONG Tie-liang2,   YANG Yan3   

  1. 1- Faculty of Mathematics and Statistics, Hubei University, Wuhan 430062
    2- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049 
    3- Faculty of Computer Science, Wuhan Qingchuan University, Wuhan 430204
  • Received:2015-12-07 Accepted:2016-10-18 Online:2017-04-15 Published:2017-06-15
  • Contact: Y. Yang. E-mail address: 41743638@qq.com
  • Supported by:
    The National Natural Science Foundation of China (61370002; 61403132); the Natural Science Foundation of Hubei Province (2015CFB404).

Abstract:

Theoretical investigation of the online algorithms has received considerable attention recently. The previous generalization bounds of online learning algorithms are usually established on the base of independent and identically distributed (i.i.d.) samples. In this paper, we go far beyond this classical framework to investigate the generalization ability of online algorithm with $\alpha$-mixing sequence. We define $\alpha$-mixing sequence by using the total variation, and our analysis requires only martingale convergence arguments. At last, ``regret" is utilized to measure the performance of online algorithms. Our main result is a tighter generalization error estimation than that of $\beta$-mixing sequence.

Key words: online algorithms, i.i.d. samples, $\alpha$-mixing sequence, generalization bound

CLC Number: