Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published June 7, 2021 | Submitted
Report Open

Visual Vibration Tomography: Estimating Interior Material Properties from Monocular Video


An object's interior material properties, while invisible to the human eye, determine motion observed on its surface. We propose an approach that estimates heterogeneous material properties of an object from a monocular video of its surface vibrations. Specifically, we show how to estimate Young's modulus and density throughout a 3D object with known geometry. Knowledge of how these values change across the object is useful for simulating its motion and characterizing any defects. Traditional non-destructive testing approaches, which often require expensive instruments, generally estimate only homogenized material properties or simply identify the presence of defects. In contrast, our approach leverages monocular video to (1) identify image-space modes from an object's sub-pixel motion, and (2) directly infer spatially-varying Young's modulus and density values from the observed modes. We demonstrate our approach on both simulated and real videos.

Additional Information

The authors would like to thank Michael Rubinstein and Bill Freeman for their helpful discussions. This work is funded by Beyond Limits Inc. B.F. is supported by a Kortschak Scholarship. C.D. and A.C.O. acknowledge support from DOE award no. DE-SC0021253 and NSF award no. 1835735.

Attached Files

Submitted - 2104.02735.pdf


Files (13.5 MB)
Name Size Download all
13.5 MB Preview Download

Additional details

August 20, 2023
October 23, 2023