Share Email Print
cover

Proceedings Paper

Measuring cues for stand-off deception detection based on full-body nonverbal features in body-worn cameras
Author(s): Henri Bouma; Gertjan Burghouts; Richard den Hollander; Sophie van der Zee; Jan Baan; Johan-Martijn ten Hove; Sjaak van Diepen; Paul van den Haak; Jeroen van Rest
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Deception detection is valuable in the security domain to distinguish truth from lies. It is desirable in many security applications, such as suspect and witness interviews and airport passenger screening. Interviewers are constantly trying to assess the credibility of a statement, usually based on intuition without objective technical support. However, psychological research has shown that humans can hardly perform better than random guessing. Deception detection is a multi-disciplinary research area with an interest from different fields, such as psychology and computer science. In the last decade, several developments have helped to improve the accuracy of lie detection (e.g., with a concealed information test, increasing the cognitive load, or measurements with motion capture suits) and relevant cues have been discovered (e.g., eye blinking or fiddling with the fingers). With an increasing presence of mobile phones and bodycams in society, a mobile, stand-off, automatic deception detection methodology based on various cues from the whole body would create new application opportunities. In this paper, we study the feasibility of measuring these visual cues automatically on different parts of the body, laying the groundwork for stand-off deception detection in more flexible and mobile deployable sensors, such as body-worn cameras. We give an extensive overview of recent developments in two communities: in the behavioral-science community the developments that improve deception detection with a special attention to the observed relevant non-verbal cues, and in the computer-vision community the recent methods that are able to measure these cues. The cues are extracted from several body parts: the eyes, the mouth, the head and the fullbody pose. We performed an experiment using several state-of-the-art video-content-analysis (VCA) techniques to assess the quality of robustly measuring these visual cues.

Paper Details

Date Published: 24 October 2016
PDF: 20 pages
Proc. SPIE 9995, Optics and Photonics for Counterterrorism, Crime Fighting, and Defence XII, 99950N (24 October 2016); doi: 10.1117/12.2241183
Show Author Affiliations
Henri Bouma, TNO (Netherlands)
Gertjan Burghouts, TNO (Netherlands)
Richard den Hollander, TNO (Netherlands)
Sophie van der Zee, TNO (Netherlands)
Jan Baan, TNO (Netherlands)
Johan-Martijn ten Hove, TNO (Netherlands)
Sjaak van Diepen, TNO (Netherlands)
Paul van den Haak, TNO (Netherlands)
Jeroen van Rest, TNO (Netherlands)


Published in SPIE Proceedings Vol. 9995:
Optics and Photonics for Counterterrorism, Crime Fighting, and Defence XII
Douglas Burgess; Gari Owen; Henri Bouma; Felicity Carlysle-Davies; Robert James Stokes; Yitzhak Yitzhaky, Editor(s)

© SPIE. Terms of Use
Back to Top