Vis enkel innførsel

dc.contributor.authorSharma, Kshitij
dc.contributor.authorNiforatos, Evangelos
dc.contributor.authorGiannakos, Michail
dc.contributor.authorKostakos, Vassilis
dc.date.accessioned2021-02-12T07:04:02Z
dc.date.available2021-02-12T07:04:02Z
dc.date.created2020-11-25T21:57:00Z
dc.date.issued2020
dc.identifier.issn2474-9567
dc.identifier.urihttps://hdl.handle.net/11250/2727546
dc.description.abstractSensing and machine learning advances have enabled the unobtrusive measurement of physiological responses and facial expressions so as to estimate one's cognitive performance. This often boils down to mapping the states of the cognitive processes underpinning human cognition: physiological responses (e.g., heart rate) and facial expressions (e.g., frowning) often reflect the states of our cognitive processes. However, it remains unclear whether physiological responses and facial expressions used in one particular task (e.g., gaming) can reliably assess cognitive performance in another task (e.g., coding), because complex and diverse tasks often require varying levels and combinations of cognitive processes. In this paper, we measure the cross-task reliability of physiological and facial responses. Specifically, we assess cognitive performance based on physiological responses and facial expressions for 123 participants in 4 independent studies (3 studies for out-of-sampling training and testing, and 1 study for evaluation only): (1) a Pac-Man game, (2) an adaptive-assessment task, (3) a code-debugging task, and (4) a gaze-based game. We follow an ensemble learning approach after cross-training and cross-testing with all possible combinations of the 3 first datasets. We save the 4th dataset only for testing purposes, and we showcase how to engineer generalizable features that predict cognitive performance. Our results show that the extracted features do generalize, and can reliably predict cognitive performance across a diverse set of cognitive tasks that require different combinations of problem-solving, decision-making, and learning processes for their completion.en_US
dc.language.isoengen_US
dc.publisherACMen_US
dc.titleAssessing cognitive performance using physiological and facial features: Generalizing across contextsen_US
dc.typePeer revieweden_US
dc.typeJournal articleen_US
dc.description.versionacceptedVersionen_US
dc.source.journalPACM on Interactive, Mobile, Wearable and Ubiquitous Technologiesen_US
dc.identifier.doi10.1145/3411811
dc.identifier.cristin1852530
dc.description.localcode© ACM, 2020. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published here, https://doi.org/10.1145/3411811en_US
cristin.ispublishedtrue
cristin.fulltextpostprint
cristin.qualitycode1


Tilhørende fil(er)

Thumbnail

Denne innførselen finnes i følgende samling(er)

Vis enkel innførsel