A Stochastic Interpretation of Stochastic Mirror Descent: Risk-Sensitive Optimality
- Creators
- Azizan, Navid
- Hassibi, Babak
Abstract
Stochastic mirror descent (SMD) is a fairly new family of algorithms that has recently found a wide range of applications in optimization, machine learning, and control. It can be considered a generalization of the classical stochastic gradient algorithm (SGD), where instead of updating the weight vector along the negative direction of the stochastic gradient, the update is performed in a "mirror domain" defined by the gradient of a (strictly convex) potential function. This potential function, and the mirror domain it yields, provides considerable flexibility in the algorithm compared to SGD. While many properties of SMD have already been obtained in the literature, in this paper we exhibit a new interpretation of SMD, namely that it is a risk-sensitive optimal estimator when the unknown weight vector and additive noise are non-Gaussian and belong to the exponential family of distributions. The analysis also suggests a modified version of SMD, which we refer to as symmetric SMD (SSMD). The proofs rely on some simple properties of Bregman divergence, which allow us to extend results from quadratics and Gaussians to certain convex functions and exponential families in a rather seamless way.
Additional Information
© 2019 IEEE. This work was supported in part by the National Science Foundation under grants CCF-1423663, CCF-1409204 and ECCS-1509977, by a grant from Qualcomm Inc., by NASA's Jet Propulsion Laboratory through the President and Director's Fund, and by an Amazon (AWS) AI Fellowship.Attached Files
Submitted - 1904.01855.pdf
Files
Name | Size | Download all |
---|---|---|
md5:bbaa192e9a07157c2353388217bf0ef2
|
381.2 kB | Preview Download |
Additional details
- Eprint ID
- 96809
- DOI
- 10.1109/CDC40024.2019.9030229
- Resolver ID
- CaltechAUTHORS:20190628-084200896
- NSF
- CCF-1423663
- NSF
- CCF-1409204
- NSF
- ECCS-1509977
- Qualcomm Inc.
- JPL President and Director's Fund
- Amazon Web Services
- Created
-
2019-06-28Created from EPrint's datestamp field
- Updated
-
2021-11-16Created from EPrint's last_modified field