Automated analysis of radar imagery of Venus: handling lack of ground truth
Abstract
Lack of verifiable ground truth is a common problem in remote sensing image analysis. For example, consider the synthetic aperture radar (SAR) image data of Venus obtained by the Magellan spacecraft. Planetary scientists are interested in automatically cataloging the locations of all the small volcanoes in this data set; however, the problem is very difficult and cannot be performed with perfect reliability even by human experts. Thus, training and evaluating the performance of an automatic algorithm on this data set must be handled carefully. We discuss the use of weighted free-response receiver-operating characteristics (wFROCs) for evaluating detection performance when the "ground truth" is subjective. In particular, we evaluate the relative detection performance of humans and automatic algorithms. Our experimental results indicate that proper assessment of the uncertainty in "ground truth" is essential in applications of this nature.
Additional Information
© 1994. Date of Current Version: 06 August 2002. The authors would like to thank Jayne Aubele and Larry Crumpler of the Department of Geological Sciences, Brown University, for their assistance in labelling images, and Maureen Burl (JPL) for assistance with the experiments. The research described in this paper was carried out by the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration.Attached Files
Published - BURicip94.pdf
Files
| Name | Size | Download all |
|---|---|---|
|
md5:860be38e5a89ccd9c7a13a9a8e5188eb
|
495.8 kB | Preview Download |
Additional details
- Eprint ID
- 29602
- Resolver ID
- CaltechAUTHORS:20120306-150027112
- NASA/JPL/Caltech
- Created
-
2012-03-12Created from EPrint's datestamp field
- Updated
-
2021-11-09Created from EPrint's last_modified field
- Other Numbering System Name
- INSPEC Accession Number
- Other Numbering System Identifier
- 5021857