Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published June 19, 2016 | Supplemental Material + Published + Submitted
Journal Article Open

Smooth Imitation Learning for Online Sequence Prediction


We study the problem of smooth imitation learning for online sequence prediction, where the goal is to train a policy that can smoothly imitate demonstrated behavior in a dynamic and continuous environment in response to online, sequential context input. Since the mapping from context to behavior is often complex, we take a learning reduction approach to reduce smooth imitation learning to a regression problem using complex function classes that are regularized to ensure smoothness. We present a learning meta-algorithm that achieves fast and stable convergence to a good policy. Our approach enjoys several attractive properties, including being fully deterministic, employing an adaptive learning rate that can provably yield larger policy improvements compared to previous approaches, and the ability to ensure stable convergence. Our empirical results demonstrate significant performance gains over previous approaches.

Additional Information

© 2016 by the author(s).

Attached Files

Published - le16.pdf

Submitted - 1606.00968.pdf

Supplemental Material - le16-supp.pdf


Files (2.5 MB)
Name Size Download all
389.1 kB Preview Download
1.1 MB Preview Download
965.0 kB Preview Download

Additional details

August 20, 2023
October 19, 2023