SPIE Startup Challenge 2015 Founding Partner - JENOPTIK Get updates from SPIE Newsroom
  • Newsroom Home
  • Astronomy
  • Biomedical Optics & Medical Imaging
  • Defense & Security
  • Electronic Imaging & Signal Processing
  • Illumination & Displays
  • Lasers & Sources
  • Micro/Nano Lithography
  • Nanotechnology
  • Optical Design & Engineering
  • Optoelectronics & Communications
  • Remote Sensing
  • Sensing & Measurement
  • Solar & Alternative Energy
  • Sign up for Newsroom E-Alerts
  • Information for:

SPIE Photonics West 2017 | Register Today

SPIE Defense + Commercial Sensing 2017 | Call for Papers

Get Down (loaded) - SPIE Journals OPEN ACCESS


Print PageEmail PageView PDF

Electronic Imaging & Signal Processing

Texture classification approach based on 2D multifractal analysis

A new technique enables accurate and efficient characterization of textural irregularities and defects.
25 March 2015, SPIE Newsroom. DOI: 10.1117/2.1201503.005806

Texture classification is a standard image processing technique, in which textures are characterized by measuring the spatial fluctuations of image amplitude. This can be achieved using multifractal analysis. Multifractal analyses deal with the scaling behavior of measure distributions in a geometrical and statistical manner, and they involve evaluating the behavior of structure function logarithms within fine-scale limits. In general, higher-resolution images permit more accurate texture classifications, but the precise image scale poses a major problem for multifractal analyses. The large number of coefficients available for linear regressions at small scales leads to an estimation bias. Excluding some of these coefficients, however, increases the estimation variance.

Purchase SPIE Field Guide to Image ProcessingMultifractal analyses can be used for the analysis of signal self-similarity, broad probability distributions, multiplicative processes, and rare events, as well as for the classification of textures. Although multifractal analysis methods have been proposed previously, improvements to the parameter that is derived in the process of multifractal analysis—known as the scaling function1, 2—can be made by reducing the computation time and increasing its accuracy. In addition, texture characterizations have rarely been based on 2D multifractal analyses in the past.

We recently presented a 2D wavelet leader-based multifractal formalism for texture classification.3 With this method, we can perform accurate, complete, low-memory, and low-processing-power multifractal characterizations of textures in complex images. We improve (in terms of accuracy and computational complexity) the performance of the multifractal spectrum—based on the wavelet leaders—with the use of multiresolution quantities. These quantities are known as maximum coefficients of discrete wavelet transform for 2D multifractal analysis, or DmaxWT. From the fractal spectrum of an image, we select discriminative multifractal features that are then applied to the texture classification using a standard nearest-neighbor classification approach.

Our new method has applications in the design of quality control instruments, and for the diagnosis of texture defects in several materials. A possible use of our approach is the automatic evaluation of some food quality aspects. We have therefore used our new texture classification technique to discriminate between raw, pasteurized, and ultra-heat-treatment (UHT) milk (see Figure 1), i.e., milk that has been heated to various degrees.4 Our experiment was conducted on 30 classes of nontraditional images (i.e., images with textures that are difficult to distinguish in a normal fashion). We used 25 samples of high-resolution images and 25 low-resolution images for each class. Our multifractal analyses of these samples are illustrated in Figure 2. In these analyses we estimated the mean values of various DmaxWT parameters, namely, the maximum and the width of the multifractal spectrum, D(h), as well as a measure of spectral asymmetry. We also calculated the standard deviation for each of these parameters. Our results indicate that the multifractal descriptor method can be used to effectively distinguish between different textures and is a viable new analysis method for identifying milk heat-treatment effects.

Figure 1. High-resolution texture images of crystallized (left) raw, (middle) pasteurized, and (right) ultra-heat-treatment (UHT) milk. This image database consisted of 1280×960 pixel red, green, blue digital images that were split into 25 different nontraditional natural texture classes.

Figure 2. Comparison between the maximum coefficient of discrete wavelet transform for the multifractal spectra DmaxWT, which were obtained during the analysis of the milk samples shown in Figure 1. Green, red, and blue symbols relate to raw, pasteurized, and UHT milk, respectively. D(h): The multifractal spectrum. h: The singularity strength (i.e., the local ‘Hölder’ exponent).

We have quantitatively evaluated the performance (bias and variance) of our texture descriptor, by conducting texture classification of two datasets. In these experiments we used a texture dataset that consisted of 30 classes of images (each with 25 high-resolution samples and 25 low-resolution samples). We selected a ‘training’ set as a fixed-size random subset of the classes, and all remaining images were used as the test set. We used a chi-squared test to compare the results from both datasets, and combined this with a one-nearest-neighbor classification. We compared the results from our approach with those obtained from various image-recognition methods, i.e., the Varma-Garg-fractal (VG-fractal),5 Varma-Zissermann-joint (VZ-joint),6 and high-level structure reconstruction (HLSR)7 techniques (see Figures 3 and 4). Through these comparisons we have verified the accuracy and efficiency of our classification approach.

Figure 3. Comparison of texture classification results on low-resolution image datasets. Results from the DmaxWT, high-level structure reconstruction (HLSR), Varma-Garg-fractal (VG-fractal), and Varma-Zissermann-joint (VZ-joint) methods are shown. The classification for the worst class is shown in (a), the mean classification for all 30 classes is shown in (b), and the classification for the best class is shown in (c).

Figure 4. Comparison of texture classification results on high-resolution image datasets. Results from the DmaxWT, high-level structure reconstruction (HLSR), VG-fractal, and VZ-joint methods are shown. The classification for the worst class is shown in (a), the mean classification for all 30 classes is shown in (b), and the classification for the best class is shown in (c).

We are able to achieve our accurate textural classifications with modest computational costs and memory needs. These requirements are in the same range as for a simple discrete wavelet transform, and are orders of magnitude lower than with the HLSR method. The VG-fractal and VZ-joint methods both have much weaker performance and higher computational costs than our new technique.

We have proposed a new method for textural classification. Our descriptor is robust to environmental changes and encodes rich textural information. We have conducted experiments on several texture datasets that show our descriptor has excellent performance. Our approach enables accurate and efficient characterization of textural irregularities and has various applications. These include the detection and classification of pathologies in biomedicine, milk classification, and potential industrial classifications. We are now planning to implement (using OpenGL or OpenCL languages) real-time texture characterization with a new high-performance graphics processor. In addition, we will soon be testing our method with an optical imaging experiment.8

Smain Femmam
University of Haute Alsace (UHA)
Mulhouse, France

Smain Femmam obtained his MS, PhD, and HDR in signal processing and computers from the University of Versailles and UHA in 1997, 1999, and 2013, respectively. He is now director of research. His main research areas are signal processing, safety systems, and communication. He is a senior IEEE member.

1. S. Mallat, A Wavelet Tour of Signal Processing, p. 832, Academic Press, San Diego, CA, 1998.
2. S. Jaffard, B. Lashermes, P. Abry, Wavelet leaders in multifractal analysis, Wavelet Analysis and Applications, p. 201-246, Birkhäuser, Basel, Switzerland, 2007.
3. A. Ouahabi, S. Femmam, Wavelet-based multifractal analysis of 1-D and 2-D signals: new results, Analog Integ. Circuits Signal Process. 69, p. 3-15, 2011.
4. A. Heilig, A. Çelik, J. Hinrichs, Suitability of Dahlem Cashmere goat milk towards pasteurisation, ultrapasteurisation, and UHT-heating with regard to sensory properties and storage stability, Small Ruminant Res. 78, p. 152-161, 2008.
5. M. Varma, R. Garg, Locally invariant fractal features for statistical texture classification, Proc. Int'l Conf. Comp. Vision 11, p. 1-8, 2007. doi:10.1109/ICCV.2007.4408876
6. M. Varma, A. Zisserman, A statistical approach to material classification using image patch exemplars, IEEE Trans. Pattern Anal. Machine Intell. 31, p. 2032-2047, 2009.
7. H. Wendt, S. G. Roux, S. Jaffard, P. Abry, Wavelet leaders and bootstrap for multifractal analysis of images, Signal Process. 89, p. 1100-1114, 2009.
8. L. Bait, S. Femmam, A. C. Boccara, J.-P. Roger, Optical imaging of high-frequency focused ultrasonic field using a Nomarski interfermeter coupled with multichannel lock-in detection. (Presented at SPIE Electronic Imaging 2014.)