Naslov
Classification of Cognitive Load based on Neurophysiological Features from Functional Near-Infrared Spectroscopy and Electrocardiography Signals on n-back Task

Autori
Kesedžić, Ivan ; Šarlija, Marko ; Božek, Jelena ; Popović, Siniša ; Ćosić, Krešimir

Izvornik
Ieee sensors journal (1530-437X) 21 (2021), 13; 14131-14140

Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, znanstveni

Ključne riječi
Cognitive load classification , electrocardiography , functional near-infrared spectroscopy , sensor fusion

Sažetak
Cognitive load can be estimated using individuals’ task performance, their subjective measures, and neurophysiological measures. Neurophysiological measures, which among others include brain activation signals obtained with various brain imaging techniques, such as the functional near- infrared spectroscopy (fNIRS), and signals from the peripheral physiology, such as the electrocardiography (ECG) signal, allow an objective and continuous estimation of cognitive load. In this paper, the fNIRS and ECG signals were simultaneously collected from 32 participants and used to classify three levels of cognitive load on n-back task. A set of 30 fNIRS and ECG features proposed in this paper enables the classification of different levels of cognitive load on n-back task using the support vector machine (SVM), k-nearest neighbors (KNN), and linear discriminant analysis (LDA) classification models. When combining the fNIRS and ECG features, three difficulties of the n-back task were classified with the mean accuracies ranging from 61% to 67%, while two difficulties were classified with the mean accuracy ranging from 70% to 84%. The most important features in the classification are discussed. The results presented in this paper extend the existing empirical evidence that combining brain imaging and peripheral physiology features increases the accuracy of multi-level cognitive load classification, thus further underscoring the importance of multimodal approach to cognitive load classification.

Izvorni jezik
Engleski

Znanstvena područja
Elektrotehnika, Računarstvo

POVEZANOST RADA