Gao, Chang and Gehlhar, Rachel and Ames, Aaron D. and Liu, Shih-Chii and Delbrück, Tobi (2020) Recurrent Neural Network Control of a Hybrid Dynamical Transfemoral Prosthesis with EdgeDRNN Accelerator. In: 2020 IEEE International Conference on Robotics and Automation (ICRA). , Piscataway, NJ, pp. 5460-5466. ISBN 9781728173955. https://resolver.caltech.edu/CaltechAUTHORS:20200527-125621566
![]() |
PDF
- Accepted Version
See Usage Policy. 2MB |
![]() |
PDF
- Submitted Version
See Usage Policy. 2MB |
Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20200527-125621566
Abstract
Lower leg prostheses could improve the life quality of amputees by increasing comfort and reducing energy to locomote, but currently control methods are limited in modulating behaviors based upon the human’s experience. This paper describes the first steps toward learning complex controllers for dynamical robotic assistive devices. We provide the first example of behavioral cloning to control a powered transfemoral prostheses using a Gated Recurrent Unit (GRU) based recurrent neural network (RNN) running on a custom hardware accelerator that exploits temporal sparsity. The RNN is trained on data collected from the original prosthesis controller. The RNN inference is realized by a novel EdgeDRNN accelerator in real-time. Experimental results show that the RNN can replace the nominal PD controller to realize endto-end control of the AMPRO3 prosthetic leg walking on flat ground and unforeseen slopes with comparable tracking accuracy. EdgeDRNN computes the RNN about 240 times faster than real time, opening the possibility of running larger networks for more complex tasks in the future. Implementing an RNN on this real-time dynamical system with impacts sets the ground work to incorporate other learned elements of the human-prosthesis system into prosthesis control.
Item Type: | Book Section | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Related URLs: |
| ||||||||||
ORCID: |
| ||||||||||
Alternate Title: | Recurrent Neural Network Control of a Hybrid Dynamic Transfemoral Prosthesis with EdgeDRNN Accelerator | ||||||||||
Additional Information: | © 2020 IEEE. This work was supported by the Samsung Global Research Neuromorphic Processor Project, the National Science Foundation Graduate Research Fellowship under Grant No. DGE1745301 and NSF NRI Grant No. 1724464 and Swiss National Center of Competence in Research Robotics (NCCR Robotics). This research was approved by California Institute of Technology Institutional Review Board with protocol no. 16-0693 for human subject testing. The authors also gratefully acknowledge discussions with Andrew Taylor and Prof. Yisong Yue, and the opportunity to build the first prototype at the July 2019 Telluride Neuromorphic Engineering Workshop. | ||||||||||
Funders: |
| ||||||||||
DOI: | 10.1109/ICRA40945.2020.9196984 | ||||||||||
Record Number: | CaltechAUTHORS:20200527-125621566 | ||||||||||
Persistent URL: | https://resolver.caltech.edu/CaltechAUTHORS:20200527-125621566 | ||||||||||
Official Citation: | C. Gao, R. Gehlhar, A. D. Ames, S. -C. Liu and T. Delbruck, "Recurrent Neural Network Control of a Hybrid Dynamical Transfemoral Prosthesis with EdgeDRNN Accelerator," 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 2020, pp. 5460-5466, doi: 10.1109/ICRA40945.2020.9196984 | ||||||||||
Usage Policy: | No commercial reproduction, distribution, display or performance rights in this work are provided. | ||||||||||
ID Code: | 103493 | ||||||||||
Collection: | CaltechAUTHORS | ||||||||||
Deposited By: | Tony Diaz | ||||||||||
Deposited On: | 27 May 2020 21:21 | ||||||||||
Last Modified: | 14 Jul 2021 21:07 |
Repository Staff Only: item control page