- Biomedical Optics & Medical Imaging
- Defense & Security
- Electronic Imaging & Signal Processing
- Illumination & Displays
- Lasers & Sources
- Micro/Nano Lithography
- Optical Design & Engineering
- Optoelectronics & Communications
- Remote Sensing
- Sensing & Measurement
- Solar & Alternative Energy
- Sign up for Newsroom E-Alerts
- Information for:
Hyperspectral imaging sustains production-process competitiveness
A newly developed imaging system aids companies in the agri-food and industrial sectors to achieve high-speed online inspection and enhanced quality control.
6 April 2010, SPIE Newsroom. DOI: 10.1117/2.1201003.002681
Because of increased worldwide competition, efficiency improvements and establishing processes that are suitable for manufacturing high-end, high-quality products are primary commercial aims. In the agri-food industry, raw-material online characterization during the input stages of processing chains is of key importance for quality control. Classification into different quality categories and separation of unwanted spurious materials are traditionally done based on time-consuming machine-vision techniques. In industrial settings, however, welding-quality monitoring plays a major role, particularly in aeronautics and the nuclear industry, and the appearance of flaws (such as porosities or inclusions) must be prevented. Using x-rays, ultrasound, or other offline nondestructive evaluation techniques is associated with both economic and productivity costs, however.
Optical spectroscopy (OS)1 has been widely used in process manufacturing, since each substance is uniquely identifiable from its spectral properties. However, traditional OS techniques generate information about the bulk properties of (or part of) a sample,2 and, in commonly used applications, many aspects of the derived sample properties result from composition heterogeneity. Imaging spectroscopy simultaneously determines the optical spectral components of a particular light-matter interaction (such as absorption) and its spatial location. It can successfully monitor sample heterogeneity. Hyperspectral imagers allow data collection in hundreds or even thousands of spectral bands. Thus, multicomponent information and high sensitivity to minor components are achieved, thus allowing enhanced quality control. Of the different types of imaging spectrometers,3 the pushbroom scanner (which simultaneously scans the spectral and one spatial dimension) is particularly suitable for industrial applications4 since conveyer-belt movement enables scanning of the other spatial dimension in a straightforward manner. These scanners allow us to obtain much more information about a given object than can be obtained from simple machine vision or single-point spectral instruments, in turn enabling a considerable increase in inspection speed.
For quality control, only the presence and position of spurious elements or weld flaws are of interest. However, hyperspectral imaging collects an immense amount of spectral information (see Figure 1). The optical spectral components of the diffuse reflectance (for raw material) or atomic emission (for welding) are measured simultaneously for every point xi along the line of sight by employing a prism-grating-prism imaging spectrograph5 placed between an objective lens and a monochrome camera. The movement of the conveyor belt or welding torch automatically provides the second spatial dimension. A light source, for example a halogen lamp with a quasi-flat spectrum, is required to illuminate the raw material. The data-compression block reduces both axes of the captured images. We have investigated distinct feature-extraction and selection methods6 to simultaneously extract relevant information for classification and achieve the highest possible compression.7,8
Figure 1. Global block diagram of our hyperspectral-imaging system for agri-food and industrial applications. LOS: Line of sight. a.u.: Arbitrary units. λ: Wavelength.
Spectral interpretation, providing material identification or flaw detection, is performed in the final stage (i.e., in the classification unit). We also considered different types of algorithms for this task. With the appropriate training, artificial neural networks (ANNs)9 proved very accurate for spurious-material detection.10 This suggested that simpler (linear) algorithms could possibly also be employed. Therefore, we proposed classification units based on Fisher's (linear) discriminant analysis (FLD)4 and spectral-angle mapper (SAM).8 However, we have not been able to unambiguously identify an optimum approach. While ANNs provide the highest accuracy, FLD and SAM yield better time performance.
Figure 2 illustrates the potential of our hyperspectral system for online raw-material discrimination in the tobacco industry, where we compare the various image-analysis methodologies. (We show photographs of some of our test samples at the top.) The second and third rows show a zoom of the scene line and the spectral image, respectively. The spatial and spectral dimensions correspond to the horizontal and vertical axes, respectively. The bottom four rows display system-discrimination results based on distinct compression and classification units. The main limitation of the system is its power requirement for sufficiently bright illumination. In addition, we obtained our classification results assuming stable illumination. It is desirable to dynamically update the responsivity calibration to equalize the system's spectral response. This would allow compensation for deviations in either the illumination spectrum or the background radiation.
Figure 2. Raw-material discrimination offered by our newly developed hyperspectral sensor. The vertical dotted lines correlate our classification results with the hyperspectral and visible images. PCA: Principal-components analysis. ANN: Artificial neural network. SFFS: Sequential-float feature selection. FLD: Fisher's (linear) discriminant analysis. SAM: Spectral-angle mapper. L: Spatial coordinate. The vertical axes in the hyperspectral images correspond to the wavelength coordinate.
Figure 3. Comparison of hyperspectral interpretation techniques and traditional plasma spectroscopy in arc-welding defect detection and classification. The white lines delineate the LOS. Te: Electron temperature.
Figure 3 illustrates the process of arc-welding defect detection and classification. We have also included a comparison with the performance of traditional plasma OS as regards the sample's electron-temperature (Te) determination.11,12 We identified a defective-weld seam section from x≈1.8 to 3.3cm, based on a reduction in welding current. The other two defective segments, from x≈3.7 to 4.8cm and from x≈6 to 7.3cm, are caused by perturbations in piece thickness and shielding gas flow. The defect-detection sensitivity of our new system is similar to that of typical plasma Te profiles.
In summary, we have illustrated the potential of hyperspectral-imaging spectroscopy for industrial applications. In fact, field tests of a preliminary version of our proposed sensor for welding-quality monitoring is currently under evaluation and used to detect defects during arc welding of steam generators for nuclear plants. In addition, we are working on an extendibility study of our system to improve economic performance in the textile industry.
Pilar Beatriz García-Allende, Olga M. Conde, Jesús M. Mirapeix, Adolfo Cobo, Jose M. Lopez-Higuera
University of Cantabria
Pilar Beatriz García-Allende received her MSc in telecommunications engineering in 2005 and is currently pursuing a PhD in the Photonics Engineering group. Her research interests focus on developing interpretation techniques and devices based on imaging spectroscopy for commercial, industrial, and medical applications.
Olga Conde received her ME and PhD degrees in telecommunications (in 1994 and 1999, respectively) from the University of Cantabria, where she is currently a faculty member in the Photonics Engineering group. Her interests focus on processing tools for OS data, light-tissue interaction modeling, and spectroscopic-system development for industrial applications.
Jesús Mirapeix received his ME and PhD degrees in telecommunications from the University of Cantabria in 2000 and 2007, respectively. His current research in the Photonics Engineering group focuses on plasma spectroscopy applied to real-time online welding-quality assurance.
Adolfo Cobo received his ME and PhD degrees in telecommunications from the University of Cantabria in 1994 and 1999, respectively. His teaching and research activities are related to optical communications and sensors for industrial applications. He has co-authored more than 100 papers in journals and conference proceedings, as well as eight patent applications.
Jose Lopez Higuera received his ME and PhD degrees in telecommunications from the Technical University of Madrid (Spain). He leads the Photonics Engineering group and is presently developing photonics instrumentation and optical-fiber sensor systems. He has co-authored more than 300 publications and obtained several patents.
6. L. Gomez-Chova, L. Calpe, G. Camps-Valls, J. D. Martin, E. Soria, J. Vila, L. Alonso-Corda, J. Moreno, Feature selection of hyperspectral data through local correlation and SFFS for crop classification, IEEE Int'l Geosci. Remote Sens. Symp. Proc. 1, pp. 555-557, 2003.