Share Email Print
cover

Proceedings Paper • new

Multimodal heartbeat rate estimation from the fusion of facial RGB and thermal videos
Author(s): Anders S. Johansen; Jesper W. Henriksen; Mohammad A. Haque; Mohammad Naser Sabet Jahromi; Kamal Nasrollahi; Thomas B. Moeslund
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Measuring Heartbeat Rate (HR) is an important tool for monitoring the health of a person. When the heart beats the influx of blood to the head causes slight involuntary movement and subtle skin color changes, which cannot be seen by the naked eye but can be tracked from facial videos using computer vision techniques and can be analyzed to estimate the HR. However, the current state of the art solutions encounter an increasing amount of complications when the subject has voluntary motion on the face or when the lighting conditions change in the video. Thus the accuracy of the HR estimation using computer vision is still inferior to that of a physical Electrocardiography (ECG) based system. The aim of this work is to improve the current non-invasive HR measurement by fusing the motion-based and color-based HR estimation methods and using them on multiple input modalities, e.g., RGB and thermal imaging. Our experiments indicate that late-fusion of the results of these methods (motion and color-based) applied to these different modalities, produces more accurate results compared to the existing solutions

Paper Details

Date Published: 15 March 2019
PDF: 8 pages
Proc. SPIE 11041, Eleventh International Conference on Machine Vision (ICMV 2018), 110410R (15 March 2019); doi: 10.1117/12.2523385
Show Author Affiliations
Anders S. Johansen, Aalborg Univ. (Denmark)
Jesper W. Henriksen, Aalborg Univ. (Denmark)
Mohammad A. Haque, Aalborg Univ. (Denmark)
Mohammad Naser Sabet Jahromi, Aalborg Univ. (Denmark)
Kamal Nasrollahi, Aalborg Univ. (Denmark)
Thomas B. Moeslund, Aalborg Univ. (Denmark)


Published in SPIE Proceedings Vol. 11041:
Eleventh International Conference on Machine Vision (ICMV 2018)
Antanas Verikas; Dmitry P. Nikolaev; Petia Radeva; Jianhong Zhou, Editor(s)

© SPIE. Terms of Use
Back to Top