Share Email Print

Proceedings Paper

Aural analysis of image texture via cepstral filtering and sonification
Author(s): Rangaraj M. Rangayyan; Antonio C. G. Martins; Ruggero Andrea Ruschioni
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Texture plays an important role in image analysis and understanding, with many applications in medical imaging and computer vision. However, analysis of texture by image processing is a rather difficult issue, with most techniques being oriented towards statistical analysis which may not have readily comprehensible perceptual correlates. We propose new methods for auditory display (AD) and sonification of (quasi-) periodic texture (where a basic texture element or `texton' is repeated over the image field) and random texture (which could be modeled as filtered or `spot' noise). Although the AD designed is not intended to be speech- like or musical, we draw analogies between the two types of texture mentioned above and voiced/unvoiced speech, and design a sonification algorithm which incorporates physical and perceptual concepts of texture and speech. More specifically, we present a method for AD of texture where the projections of the image at various angles (Radon transforms or integrals) are mapped to audible signals and played in sequence. In the case of random texture, the spectral envelopes of the projections are related to the filter spot characteristics, and convey the essential information for texture discrimination. In the case of periodic texture, the AD provides timber and pitch related to the texton and periodicity. In another procedure for sonification of periodic texture, we propose to first deconvolve the image using cepstral analysis to extract information about the texton and horizontal and vertical periodicities. The projections of individual textons at various angles are used to create a voiced-speech-like signal with each projection mapped to a basic wavelet, the horizontal period to pitch, and the vertical period to rhythm on a longer time scale. The sound pattern then consists of a serial, melody-like sonification of the patterns for each projection. We believe that our approaches provide the much-desired `natural' connection between the image data and the sounds generated. We have evaluated the sonification techniques with a number of synthetic textures. The sound patterns created have demonstrated the potential of the methods in distinguishing between different types of texture. We are investigating the application of these techniques to auditory analysis of texture in medical images such as magnetic resonance images.

Paper Details

Date Published: 8 March 1996
PDF: 12 pages
Proc. SPIE 2656, Visual Data Exploration and Analysis III, (8 March 1996);
Show Author Affiliations
Rangaraj M. Rangayyan, Univ. of Calgary (Canada)
Antonio C. G. Martins, Univ. de Sao Paulo (Brazil)
Ruggero Andrea Ruschioni, Univ. de Sao Paulo (Brazil)

Published in SPIE Proceedings Vol. 2656:
Visual Data Exploration and Analysis III
Georges G. Grinstein; Robert F. Erbacher, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?