无中心优化的算子分裂方法
OPERATOR SPLITTING METHODS FOR DECENTRALIZED OPTIMIZATION
查看参考文献50篇
|
文摘
|
在某些多智能体系统中,由于受到通讯等因素的限制,单个智能体只能进行本地计算,再与相邻智能体交换数据.与传统的并行和分布式计算不同,这种数据交换方式不再使用中心节点或者共享内存,而仅限于相邻节点之间.这种通过局部数据交换而实现全网目标的方式叫做无中心计算.比如,从任意的多个数开始,所有智能体通过不断地计算其局部平均,就都能收敛到这些数的平均值.无中心计算有不易形成通讯和计算瓶颈的优点.更适合分布的节点,因此受到一些应用的欢迎.本文介绍求解一致最优化问题的若干无中心算法.一致最优化问题的目标是全网所有节点的变量收敛到同一个、并使所有目标函数之和最小的值.我们可以通过推广求平均的无中心方法去实现这个目标,但是得到算法比普通(有中心的)优化算法收敛得更慢,有阶数差距.近年来,一些新的无中心算法弥补了这个阶数差距.本文采用算子分裂的统一框架,以比这些算法原文更为简单的形式介绍这些方法. |
|
其他语种文摘
|
Many problems in multi-agent systems, due to communication restrictions, need to be solved in a decentralized manner. There is no data fusion center, so we must rely on shortdistance communication between adjacent nodes to achieve the goal of the whole network. Compared with traditional (centralized) computing, decentralized computing is more suitable for distributed data, less subject to communication and computing bottlenecks, and easier to realize in some applications. This article overviews the formulations and methods of decentralized consensus optimization. The objective of consensus optimization is that all the variables of the nodes converge to the same vector that minimizes the sum of their objective functions. This problem is solved by calculations at each node and data exchanges between adjacent nodes. Naive decentralized algorithms are much slower than their centralized counterparts. In order to make up for this gap, we review some recent methods through a unified framework of operator splitting. |
|
来源
|
计算数学
,2019,41(3):225-241 【核心库】
|
|
关键词
|
无中心算法
;
一致优化
;
算子分裂
;
单调算子
|
|
地址
|
阿里巴巴(美国)达摩院
|
|
语种
|
中文 |
|
文献类型
|
研究性论文 |
|
ISSN
|
0254-7791 |
|
学科
|
自动化技术、计算机技术 |
|
文献收藏号
|
CSCD:6548342
|
参考文献 共
50
共3页
|
|
1.
Cattivelli F S. A diffusion RLS scheme for distributed estimation over adaptive networks.
2007 IEEE 8th Workshop on Signal Processing Advances in Wireless Communications,2007:1-5
|
CSCD被引
1
次
|
|
|
|
|
2.
Cattivelli F S. Diffusion LMS strategies for distributed estimation.
IEEE Transactions on Signal Processing,2010,58(3):1035-1048
|
CSCD被引
31
次
|
|
|
|
|
3.
Kun Yuan. On the convergence of decentralized gradient descent.
SIAM Journal on Optimization,2016,26(3):1835-1854
|
CSCD被引
1
次
|
|
|
|
|
4.
Chen Annie I-An.
Fast Distributed First-Order Methods. Thesis,2012
|
CSCD被引
1
次
|
|
|
|
|
5.
Dusan Jakovetic. Moura. Fast distributed gradient methods.
IEEE Transactions on Automatic Control,2014,59(5):1131-1146
|
CSCD被引
18
次
|
|
|
|
|
6.
Jinshan Zeng. On nonconvex decentralized gradient descent.
IEEE Transactions on Signal Processing,2018,66(11):2834-2848
|
CSCD被引
1
次
|
|
|
|
|
7.
Ryu Ernest K.
Primer on monotone operator methods. Technical report,2015
|
CSCD被引
1
次
|
|
|
|
|
8.
Ernest Ryu. Scaled relative graph: Nonexpansive operators via 2D Euclidean geometry.
arXiv: 1902.09788:2019
|
CSCD被引
1
次
|
|
|
|
|
9.
Bauschke Heinz H.
Convex Analysis and Monotone Operator Theory in Hilbert Spaces. CMS Books in Mathematics,2011
|
CSCD被引
1
次
|
|
|
|
|
10.
David Kempe. Gossip-based computation of aggregate information.
Proceedings of the 44th Annual IEEE Symposium on Foundations of Computer Science, FOCS '03,2003:482
|
CSCD被引
1
次
|
|
|
|
|
11.
Angelia Nedic. Distributed optimization over time-varying directed graphs.
IEEE Transactions on Automatic Control,2015,60(3):601-615
|
CSCD被引
42
次
|
|
|
|
|
12.
Glowinski R. Sur l'approximation, par elements finis d'ordre un, et la resolution, par penalisation-dualite d'une classe de problemes de Dirichlet non lineaires.
ESAIM: Mathematical Modelling and Numerical Analysis,1975,9(R2):41-76
|
CSCD被引
16
次
|
|
|
|
|
13.
Lions P L. Splitting algorithms for the sum of two nonlinear operators.
SIAM Journal on Numerical Analysis,1979,16(6):964-979
|
CSCD被引
42
次
|
|
|
|
|
14.
Neal Parikh. Proximal algorithms.
Foundations and Trends in Optimization,2014,1(3):127-239
|
CSCD被引
59
次
|
|
|
|
|
15.
Hao-Jun Michael Shi.
A primer on coordinate descent algorithms. UCLA CAM Report 16-67,2016
|
CSCD被引
1
次
|
|
|
|
|
16.
Giovanni Chierchia.
The proximity operator repository (user's guide). Technical Report version 0.1, proximity-operator.net,2017
|
CSCD被引
1
次
|
|
|
|
|
17.
Bruck Ronald E Jr. An iterative solution of a variational inequality for certain monotone operators in Hilbert space.
Bulletin of the American Mathematical Society,1975,81(5):890-893
|
CSCD被引
1
次
|
|
|
|
|
18.
Gregory B. Passty. Ergodic convergence to a zero of the sum of monotone operators in Hilbert space.
Journal of Mathematical Analysis and Applications,1979,72(2):383-390
|
CSCD被引
1
次
|
|
|
|
|
19.
Damek Davis. Convergence rate analysis of several splitting schemes.
Splitting Methods in Communication, Imaging, Science and Engineering, Chapter 4,2016:115-163
|
CSCD被引
1
次
|
|
|
|
|
20.
Damek Davis. Faster convergence rates of relaxed Peaceman-Rachford and ADMM under regularity assumptions.
Mathematics of Operations Research,2017,42(3):783-805
|
CSCD被引
1
次
|
|
|
|
|
了解气象卫星更多信息，请访问