Share Email Print

Proceedings Paper

BNU-LSVED: a multimodal spontaneous expression database in educational environment
Author(s): Bo Sun; Qinglan Wei; Jun He; Lejun Yu; Xiaoming Zhu
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In the field of pedagogy or educational psychology, emotions are treated as very important factors, which are closely associated with cognitive processes. Hence, it is meaningful for teachers to analyze students’ emotions in classrooms, thus adjusting their teaching activities and improving students ’ individual development. To provide a benchmark for different expression recognition algorithms, a large collection of training and test data in classroom environment has become an acute problem that needs to be resolved. In this paper, we present a multimodal spontaneous database in real learning environment. To collect the data, students watched seven kinds of teaching videos and were simultaneously filmed by a camera. Trained coders made one of the five learning expression labels for each image sequence extracted from the captured videos. This subset consists of 554 multimodal spontaneous expression image sequences (22,160 frames) recorded in real classrooms. There are four main advantages in this database. 1) Due to recorded in the real classroom environment, viewer’s distance from the camera and the lighting of the database varies considerably between image sequences. 2) All the data presented are natural spontaneous responses to teaching videos. 3) The multimodal database also contains nonverbal behavior including eye movement, head posture and gestures to infer a student ’ s affective state during the courses. 4) In the video sequences, there are different kinds of temporal activation patterns. In addition, we have demonstrated the labels for the image sequences are in high reliability through Cronbach's alpha method.

Paper Details

Date Published: 14 September 2016
PDF: 7 pages
Proc. SPIE 9970, Optics and Photonics for Information Processing X, 997016 (14 September 2016); doi: 10.1117/12.2235892
Show Author Affiliations
Bo Sun, Beijing Normal Univ. (China)
Qinglan Wei, Beijing Normal Univ. (China)
Jun He, Beijing Normal Univ. (China)
Lejun Yu, Beijing Normal Univ. (China)
Xiaoming Zhu, Beijing Normal Univ. (China)

Published in SPIE Proceedings Vol. 9970:
Optics and Photonics for Information Processing X
Khan M. Iftekharuddin; Abdul A. S. Awwal; Mireya García Vázquez; Andrés Márquez; Mohammad A. Matin, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?