Share Email Print

Proceedings Paper

Algorithm development for automated outlier detection and background noise reduction during NIR spectroscopic data processing
Author(s): David Abookasis; Jerome J. Workman
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

This study describes a hybrid processing algorithm for use during calibration/validation of near-infrared spectroscopic signals based on a spectra cross-correlation and filtering process, combined with a partial-least square regression (PLS) analysis. In the first step of the algorithm, exceptional signals (outliers) are detected and remove based on spectra correlation criteria we have developed. Then, signal filtering based on direct orthogonal signal correction (DOSC) was applied, before being used in the PLS model, to filter out background variance. After outlier screening and DOSC treatment, a PLS calibration model matrix is formed. Once this matrix has been built, it is used to predict the concentration of the unknown samples. Common statistics such as standard error of cross-validation, mean relative error, coefficient of determination, etc. were computed to assess the fitting ability of the algorithm Algorithm performance was tested on several hundred blood samples prepared at different hematocrit and glucose levels using blood materials from thirteen healthy human volunteers. During measurements, these samples were subjected to variations in temperature, flow rate, and sample pathlength. Experimental results highlight the potential, applicability, and effectiveness of the proposed algorithm in terms of low error of prediction, high sensitivity and specificity, and low false negative (Type II error) samples.

Paper Details

Date Published: 16 September 2011
PDF: 9 pages
Proc. SPIE 8137, Signal and Data Processing of Small Targets 2011, 813703 (16 September 2011);
Show Author Affiliations
David Abookasis, Ariel Univ. Ctr. of Samaria (Israel)
Jerome J. Workman, Biotechnology Business Associates (United States)
Liberty Univ. (United States)
United States National Univ. (United States)

Published in SPIE Proceedings Vol. 8137:
Signal and Data Processing of Small Targets 2011
Oliver E. Drummond, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?