
Proceedings Paper
An audiovisual emotion recognition systemFormat | Member Price | Non-Member Price |
---|---|---|
$17.00 | $21.00 |
Paper Abstract
Human emotions could be expressed by many bio-symbols. Speech and facial expression are two of them. They are both
regarded as emotional information which is playing an important role in human-computer interaction. Based on our
previous studies on emotion recognition, an audiovisual emotion recognition system is developed and represented in this
paper. The system is designed for real-time practice, and is guaranteed by some integrated modules. These modules
include speech enhancement for eliminating noises, rapid face detection for locating face from background image,
example based shape learning for facial feature alignment, and optical flow based tracking algorithm for facial feature
tracking. It is known that irrelevant features and high dimensionality of the data can hurt the performance of classifier.
Rough set-based feature selection is a good method for dimension reduction. So 13 speech features out of 37 ones and 10
facial features out of 33 ones are selected to represent emotional information, and 52 audiovisual features are selected
due to the synchronization when speech and video fused together. The experiment results have demonstrated that this
system performs well in real-time practice and has high recognition rate. Our results also show that the work in multimodules
fused recognition will become the trend of emotion recognition in the future.
Paper Details
Date Published: 9 January 2008
PDF: 6 pages
Proc. SPIE 6794, ICMIT 2007: Mechatronics, MEMS, and Smart Materials, 679426 (9 January 2008); doi: 10.1117/12.784485
Published in SPIE Proceedings Vol. 6794:
ICMIT 2007: Mechatronics, MEMS, and Smart Materials
Minoru Sasaki; Gisang Choi Sang; Zushu Li; Ryojun Ikeura; Hyungki Kim; Fangzheng Xue, Editor(s)
PDF: 6 pages
Proc. SPIE 6794, ICMIT 2007: Mechatronics, MEMS, and Smart Materials, 679426 (9 January 2008); doi: 10.1117/12.784485
Show Author Affiliations
Yi Han, Chongqing Univ. of Posts and Telecommunications (China)
Guoyin Wang, Chongqing Univ. of Posts and Telecommunications (China)
Southwest Jiaotong Univ. (China)
Guoyin Wang, Chongqing Univ. of Posts and Telecommunications (China)
Southwest Jiaotong Univ. (China)
Yong Yang, Chongqing Univ. of Posts and Telecommunications (China)
Southwest Jiaotong Univ. (China)
Kun He, Chongqing Univ. of Posts and Telecommunications (China)
Southwest Jiaotong Univ. (China)
Kun He, Chongqing Univ. of Posts and Telecommunications (China)
Published in SPIE Proceedings Vol. 6794:
ICMIT 2007: Mechatronics, MEMS, and Smart Materials
Minoru Sasaki; Gisang Choi Sang; Zushu Li; Ryojun Ikeura; Hyungki Kim; Fangzheng Xue, Editor(s)
© SPIE. Terms of Use
