Distributed deep networks based on Bagging-Down SGD algorithm
Qin, C, Gao, X and Chen, D (2019). Distributed deep networks based on Bagging-Down SGD algorithm. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics. 41 (5), pp. 1021-1027.
|Authors||Qin, C, Gao, X and Chen, D|
© 2019, Editorial Office of Systems Engineering and Electronics. All right reserved. As a cutting-edge disruptive technology, deep learning and unsupervised learning have attracted a significant research attention, and it has been widely acknowledged that training big data with a distributed deep learning algorithm can get better structures. However, there are two main problems with traditional distributed deep learning algorithms: the speed of training is slow and the accuracy of training is low. The Bootstrap aggregating-down stochastic gradient descent (Bagging-Down SGD) algorithm is proposed to solve the speed problem mainly. We add a speed controller to update the parameters of the single machine statistically, and to split model training and parameters updating to improve the training speed with the assurance of the same accuracy. It is to be proved in the experiment that the algorithm has the generality to learn the structures of different kinds of data. This article is in Chinese.
|Journal||Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics|
|Journal citation||41 (5), pp. 1021-1027|
|Digital Object Identifier (DOI)||doi:10.3969/j.issn.1001-506X.2019.05.13|
|01 May 2019|
|Publication process dates|
|Deposited||15 Jul 2019|
|Accepted||01 Mar 2019|
|Accepted author manuscript|
CC BY 4.0
Accepted author manuscript
2views this month
0downloads this month