|
Math @ Duke
|
Publications [#322381] of Rong Ge
Papers Published
- Frostig, R; Ge, R; Kakade, SM; Sidford, A, Un-regularizing: Approximate proximal point and faster stochastic algorithms for empirical risk minimization,
32nd International Conference on Machine Learning Icml 2015, vol. 3
(January, 2015),
pp. 2530-2538, ISBN 9781510810587
(last updated on 2026/01/17)
Abstract: We develop a family of accelerated stochastic algorithms that optimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression, across a wide range of problem settings. To achieve this, we establish a framework, based on the classical proximal point algorithm, useful for accelerating recent fast stochastic algorithms in a black-box fashion. Empirically, we demonstrate that the resulting algorithms exhibit notions of stability that are advantageous in practice. Both in theory and in practice, the provided algorithms reap the computational benefits of adding a large strongly convex regularization term, without incurring a corresponding bias to the original ERM problem.
|
|
|
|
dept@math.duke.edu
ph: 919.660.2800
fax: 919.660.2821
| |
Mathematics Department
Duke University, Box 90320
Durham, NC 27708-0320
|
|