Share Email Print

Proceedings Paper

Pixel level data fusion: from algorithm to chip
Author(s): Bimal P. Mathur; H. Taichi Wang; Shih-Chi Liu; Christof Koch; Jin Luo
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Pixel level image processing algorithms have to work with noisy sensor data to extract spatial features. This often required the use of operators which amplify high frequency noise. One method of dealing with this problem is to perform image smoothing prior to any use of spatial differentiation. Such spatial smoothing results in the spread of object characteristics beyond the object boundaries. Identification of discontinuities and explicit use of these as boundaries for smoothing has been proposed as a technique to overcome this problem. This approach has been used to perform cooperative computations between multiple descriptions of the scene, e.g., fusion of edge and motion field for a given scene. This approach is extended to multisensor systems. The discontinuities detected in the output of one sensor are used to define regions of smoothing for a second sensor. For example, the depth discontinuities present in laser radar can be used to define smoothing boundaries for infrared focal plane arrays. The authors have recently developed a CMOS chip (28 X 36) which performs this task in real time. This chip consists of a resistive network and elements that can be switched ON or OFF, by loading a suitable bit pattern. The bit pattern for the control of switches can be generated from the discontinuities found in the output of sensor #1. The output of sensor #2 is applied to the resistive network for data smoothing. If all the switches are held in conducting state, this chip performs the usual data smoothing. However, if switches along object boundaries are turned OFF, a region for bounded smoothing is created. In this chip, information from a third sensor data (e.g., intensity data from laser radar) can be incorporated in the form of a map of 'confidence in data.' The results obtained with this chip using synthetic data and other potential applications of this chip are described.

Paper Details

Date Published: 9 July 1991
PDF: 8 pages
Proc. SPIE 1473, Visual Information Processing: From Neurons to Chips, (9 July 1991); doi: 10.1117/12.45548
Show Author Affiliations
Bimal P. Mathur, Rockwell International Science Ctr. (United States)
H. Taichi Wang, Rockwell International Science Ctr. (United States)
Shih-Chi Liu, Rockwell International Science Ctr. (United States)
Christof Koch, California Institute of Technology (United States)
Jin Luo, California Institute of Technology (United States)

Published in SPIE Proceedings Vol. 1473:
Visual Information Processing: From Neurons to Chips
Bimal P. Mathur; Christof Koch, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?