Physical object identification using micro-structure images

Micro-structures provide unique identifiers for physical objects, and since they can be optically detected with a mobile device, they can be applied in fields from security and forensics to anti-counterfeiting.

01 December 2014
Svyatoslav Voloshynovskiy, Maurits Diephuis, Taras Holotyak and Nabil Standardo

A micro-structure is the common name for all fine-surface details and material properties visible when a physical object is examined at close range or under magnification. In its most basic form, the micro-structure image serves as a unique, non-cloneable identifier for that object (see Figure 1). It is non-cloneable as the current level of material science technology cannot practically produce a physical object with the precision required to clone a specific micro-structure.

This protection scheme is attractive and highly competitive for large-scale, mass-market applications because of the non-invasive character of the protection and its easy, fast verification by non-experts using a mobile device. Applications include security documents, luxury items, spare aviation parts, and electronics. The non-cloneable character and uniqueness also mean that the deployed processing chain as well as the identification and authentication technologies share many elements with existing biometrics systems.

Figure 1. (a) A handheld mobile acquisition of a SPIE Certificate and (b-c) two extracted patches of an identical sample without any special equipment or lighting. Histogram equalization was used for visualization purposes.

We focused our micro-structure architecture elements on extracting the correct image patch, selecting robust or invariant features, dimensionality reduction, and quantization, resulting in a binary representation of the original image (see Figure 2). The acquired samples contain a printed mark used as a guide to extract the correct image patch from a fixed, determined position containing the micro-structure. This extraction needs to be vastly more precise than, for example, computer vision stitching applications. Extracted micro-patches without any geometrical distortions can be successfully modeled as Gaussian i.i.d realizations with additive white noise. This makes analytical analysis of the rest of the processing chain possible, including dimensionality reduction and quantization.1 Identification systems based on micro-structure fingerprints are elegant and fast.

Figure 2. The architectures for feature-based authentication (left) and fingerprint-based identification (right).

If the printed mark is not used or is of insufficient quality, and the user wishes to use a handheld consumer mobile device, authentication is still possible using computer vision features. This processing chain is more intensive, as it now has to handle all kinds of geometrical and lighting distortions. The sensitivity of image features must be adapted for micro-structures, as these images are by far not as visually rich as natural scene photos. Feature detection is followed by several steps that detect outliers and verify geometric consistency between a query and a database item. Our tests showed that sample authentication was possible under these conditions if a more complex architecture is acceptable.2, 3

We used and distributed three data sets that are publicly available for testing and development.4 We acquired the forensic authentication microstructure optical set (FAMOS) industrial data set with high-quality cameras and controlled lighting. The two other data sets, FAMOS-M-L and FAMOS-M-S, contain samples acquired with a handheld mobile phone without special lighting. In both cases, our originating objects were consumer paper packages such as an ordinary medicine box.

We judged our results using two criteria: Pm, the probability of a miss, and Pfa, the probability of a false alarm. A false alarm occurs when a false or non-enrolled item is wrongly accepted by the system as genuine, and a miss constitutes the rejection of a genuine enrolled item. Ideally, both should be zero.

Identification results based on an extracted and synchronized mark on the industrial FAMOS set are shown in Figure 3. Unsurprisingly, we obtained the best results when the enrollment and verification cameras are identical. This architecture is fast and allows for deployment of advanced digital fingerprinting methods when acquisition specifications are met.

Figure 3. Receiver operating characteristic curves for all deployed cameras in the forensic authentication microstructure optical set (FAMOS) industrial dataset comparing extracted synchronized patches using cross correlation. Pfa: The probability of authenticating a non-enrolled or counterfeited item as genuine. Pm: The probability of a miss of an enrolled item.

Our results using a consumer mobile device, shown in Table 1, demonstrated that feature package identification is possible while using relatively small patches and preventing false matches from non-discriminative weak descriptors. Going forward, our research will focus on further developing robust features specifically tailored for micro-structures.

Table 1.FAMOS-M-L and FAMOS-M-S results for feature-based identification. Pfa: Probability of a false alarm. Pm: Probability of a miss.
Pfa 0.0287 0.016
Pm 0.0025 0

Svyatoslav Voloshynovskiy, Maurits Diephuis, Taras Holotyak, Nabil Standardo
University of Geneva
Carouge, Switzerland

Slava Voloshynovskiy is currently a tenured associate professor and head of the Stochastic Information Processing Group. His research interests cover the theoretical analysis of the entire chain of multimedia processing. He has coauthored more than 250 journal and conference papers as well as 10 patents.

1. S. Voloshynovskiy, M. Diephuis, F. Beekhof, O. Koval, B. Keel, Towards reproducible results in authentication based on physical non-cloneable functions: the forensic authentication microstructure optical set (FAMOS), Proc. IEEE Int'l. Workshop Info. Forensics and Security, Tenerife, Spain, 2012.
2. M. Diephuis, S. Voloshynovskiy, Physical object identification based on FAMOS microstructure fingerprinting: comparison of templates versus invariant features, Proc. 8th Int'l. Symp. Image and Signal Process. and Anal. , Trieste, Italy, 2013.
3. M. Diephuis, S. Voloshynovskiy, T. Holotyak, N. Standardo, B. Keel, A framework for fast and secure packaging identification on mobile phones, Proc. SPIE 9028, p. 90280T, 2014. doi:10.1117/12.2039638
4. The forensic authentication microstructure optical set (FAMOS) is a dataset with 5000 unique microstructures from consumer packages for the development, testing and benchmarking of forensic identification and authentication technologies. Accessed 13 October 2014
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?