A Caltech Library Service

Pixel-level data fusion: from algorithm to chip

Mathur, Bimal and Wang, H. Taichi and Liu, Shih-Chi and Koch, Christof and Luo, Jin (1991) Pixel-level data fusion: from algorithm to chip. In: Visual Information Processing: From Neurons to Chips. Proceedings of SPIE. No.1473. Society of Photo-optical Instrumentation Engineers (SPIE) , Bellingham, WA, pp. 153-160. ISBN 9780819405821.

[img] PDF - Published Version
See Usage Policy.


Use this Persistent URL to link to this item:


Pixel level image processing algorithms have to work with noisy sensor data to extract spatial features. This often required the use of operators which amplify high frequency noise. One method of dealing with this problem is to perform image smoothing prior to any use of spatial differentiation. Such spatial smoothing results in the spread of object characteristics beyond the object boundaries. Identification of discontinuities and explicit use of these as boundaries for smoothing has been proposed as a technique to overcome this problem. This approach has been used to perform cooperative computations between multiple descriptions of the scene, e.g., fusion of edge and motion field for a given scene. This approach is extended to multisensor systems. The discontinuities detected in the output of one sensor are used to define regions of smoothing for a second sensor. For example, the depth discontinuities present in laser radar can be used to define smoothing boundaries for infrared focal plane arrays. The authors have recently developed a CMOS chip (28 X 36) which performs this task in real time. This chip consists of a resistive network and elements that can be switched ON or OFF, by loading a suitable bit pattern. The bit pattern for the control of switches can be generated from the discontinuities found in the output of sensor #1. The output of sensor #2 is applied to the resistive network for data smoothing. If all the switches are held in conducting state, this chip performs the usual data smoothing. However, if switches along object boundaries are turned OFF, a region for bounded smoothing is created. In this chip, information from a third sensor data (e.g., intensity data from laser radar) can be incorporated in the form of a map of 'confidence in data.' The results obtained with this chip using synthetic data and other potential applications of this chip are described.

Item Type:Book Section
Related URLs:
URLURL TypeDescription
Koch, Christof0000-0001-6482-8067
Additional Information:© 1991 Society of Photo-Optical Instrumentation Engineers (SPIE).
Group:Koch Laboratory (KLAB)
Series Name:Proceedings of SPIE
Issue or Number:1473
Record Number:CaltechAUTHORS:20181213-143632997
Persistent URL:
Official Citation:Bimal P. Mathur, H. Taichi Wang, Shih-Chi Liu, Christof Koch, Jin Luo, "Pixel level data fusion: from algorithm to chip," Proc. SPIE 1473, Visual Information Processing: From Neurons to Chips, (9 July 1991); doi: 10.1117/12.45548
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:91815
Deposited By: George Porter
Deposited On:18 Dec 2018 21:26
Last Modified:16 Nov 2021 03:44

Repository Staff Only: item control page