Share Email Print


Decoding semantic representations from functional near-infrared spectroscopy signals
Author(s): Benjamin D. Zinszer; Laurie Bayet; Lauren L. Emberson; Rajeev D. S. Raizada; Richard N. Aslin
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

This study uses representational similarity-based neural decoding to test whether semantic information elicited by words and pictures is encoded in functional near-infrared spectroscopy (fNIRS) data. In experiment 1, subjects passively viewed eight audiovisual word and picture stimuli for 15 min. Blood oxygen levels were measured using the Hitachi ETG-4000 fNIRS system with a posterior array over the occipital lobe and a left lateral array over the temporal lobe. Each participant’s response patterns were abstracted to representational similarity space and compared to the group average (excluding that subject, i.e., leave-one-out cross-validation) and to a distributional model of semantic representation. Mean accuracy for both decoding tasks significantly exceeded chance. In experiment 2, we compared three group-level models by averaging the similarity structures from sets of eight participants in each group. In these models, the posterior array was accurately decoded by the semantic model, while the lateral array was accurately decoded in the between-groups comparison. Our findings indicate that semantic representations are encoded in the fNIRS data, preserved across subjects, and decodable by an extrinsic representational model. These results are the first attempt to link the functional response pattern measured by fNIRS to higher-level representations of how words are related to each other.

Paper Details

Date Published: 23 August 2017
PDF: 8 pages
Neurophoton. 5(1) 011003 doi: 10.1117/1.NPh.5.1.011003
Published in: Neurophotonics Volume 5, Issue 1
Show Author Affiliations
Benjamin D. Zinszer, Univ. of Rochester (United States)
Laurie Bayet, Univ. of Rochester (United States)
Boston Children’s Hospital (United States)
Harvard Medical School (United States)
Lauren L. Emberson, Princeton Univ. (United States)
Rajeev D. S. Raizada, Univ. of Rochester (United States)
Richard N. Aslin, Univ. of Rochester (United States)

© SPIE. Terms of Use
Back to Top