CaltechAUTHORS
  A Caltech Library Service

Towards a humanoid-oriented movement writing

Stoica, Adrian and Suh, Hyung Ju and Hewitt, Steven M. and Bechtle, Sarah and Gruebler, Anna and Iwashita, Yumi (2017) Towards a humanoid-oriented movement writing. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE , Piscataway, NJ, pp. 3266-3271. ISBN 978-1-5386-1645-1. http://resolver.caltech.edu/CaltechAUTHORS:20171221-150405616

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20171221-150405616

Abstract

This paper introduces humanoid-oriented movement writing (HOM), focusing on a notation in which body postures allow easy visual interpretation by both humans and humanoid robots. HOM Writing, derived from Sutton Movement Writing and Shorthand [1], is a natural modality for encoding the movements that humans perform during various work activities. Beyond its use as a record of human movement, the intent is to use the writing as a modality of communicating to robots what movements to execute. Humanoid robots could directly map the key postures represented in the notation to their own postures, imitating the postures captured in the description, and calculating intermediate postures by interpolation. A motion generator would ensure the motor control needed to create continuous movements. This paper focuses on the generation of the activity movement scripts, and addresses two modalities of producing the scripts: 1) ‘hand-coded’ by a human, using an editor, and 2) automatic extraction from video, e.g. from video-recordings of a human performing an activity. A software tool developed to allow easy script writing, the HOM Editor, is described and illustrated in hand-coding of a sequence of movements. The automatic generation of scripts from video is done using the pose estimation system by Yang and Ramanan [2], which takes an image and produces the joint coordinates of the limb parts; this is illustrated with a task of moving and arranging chairs. The posture extraction from a video provided by a single camera may often lead to occlusions of body parts during activities in which objects are manipulated. We show the advantages of using an additional camera, which significantly increases the correct posture estimation, and discuss how to further improve the automatic generation of scripts.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
https://doi.org/10.1109/SMC.2017.8123132DOIArticle
http://ieeexplore.ieee.org/document/8123132PublisherArticle
Additional Information:© 2017 IEEE. Research performed at the Jet Propulsion Laboratory, California Institute of Technology, Pasadena CA 91107, under a contract with the National Aeronautics and Space Administration (NASA). This research was performed at the Jet Propulsion Laboratory, California Institute of Technology, Pasadena CA 91107, under a contract with the National Aeronautics and Space Administration (NASA). The authors wish to thank the anonymous reviewers for their helpful suggestions to the early manuscript.
Funders:
Funding AgencyGrant Number
NASA/JPL/CaltechUNSPECIFIED
Record Number:CaltechAUTHORS:20171221-150405616
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:20171221-150405616
Official Citation:A. Stoica, H. J. Suh, S. M. Hewitt, S. Bechtle, A. Gruebler and Y. Iwashita, "Towards a humanoid-oriented movement writing," 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, 2017, pp. 3266-3271. doi: 10.1109/SMC.2017.8123132. URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8123132&isnumber=8122565
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:84005
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:22 Dec 2017 00:02
Last Modified:22 Dec 2017 00:02

Repository Staff Only: item control page