On the Convergence of Decentralized Gradient Descent

Consider the consensus problem of minimizing f(x)=\sum_{i=1}^n f_i(x) where x\in{\mathbb{R}}^pand each f_iis only known to the individual agent iin a connected network of nagents. To solve this problem and obtain the solution, all the agents collaborate with their neighbors through information exchange. This type of decentralized computation does not need a fusion center, offers better network load balance, and improves data...