An Efficient Deep-Learning-Based Solution for the Recognition of Relative Changes in Mental Workload Using Wearable Sensors - Artificial Intelligence Lab, IRT b<>com Access content directly
Conference Papers Year : 2023

An Efficient Deep-Learning-Based Solution for the Recognition of Relative Changes in Mental Workload Using Wearable Sensors

Majd Saleh
  • Function : Author
  • PersonId : 1337958
Stéphane Paquelet
  • Function : Author
  • PersonId : 1105679
Pierre Castel
  • Function : Author
  • PersonId : 1337959
Marc Hoarau
  • Function : Author
  • PersonId : 1337960
Nico Pallamin
  • Function : Author
  • PersonId : 1010799
Daniel Lewkowicz
  • Function : Author
  • PersonId : 1337961

Abstract

In this work, a new solution for the automatic recognition of relative changes in mental workload is proposed. Wearable sensors were used to collect EEG, EDA, PPG and eyetracking data from 26 human subjects while performing the nback task with three difficulty levels n ∈ {1, 2, 3}. The objective is to recognize whether the mental workload is increasing, decreasing or stable by comparing the current signals' window with a previous one. The proposed 3-class classifier uses mainly CNN layers with a novel merging layer that systematically captures the interactions between local segments of the two inspected windows. In fact, it is inspired by the competitive success of both transformer-and CNN-based networks in time series classification. While the proposed solution exploits the efficiency of CNN networks, it also enjoys, similar to transformers, the capacity of capturing the interactions between local events of the sequence thanks to the proposed merging layer. In terms of accuracy, experimental results show the superiority of the proposed solution over classical CNN, BiLSTM and transformer networks on eye-direction, PPG and EEG data while its performance is comparable with the transformer networks on eye-pupil-diameter and EDA data. The average training time per epoch is considerably smaller than the ones of transformer and BiLSTM networks as shown in the experimental results. Index Terms-Mental workload (MWL), deep neural networks (DNNs), time series classification (TSC), eye-tracking, photoplethysmogram (PPG), electroencephalogram (EEG), electrodermal activity (EDA), n-back task, transformer neural network, convolutional neural network (CNN).
Fichier principal
Vignette du fichier
MWL_camera ready_HAL.pdf (1017.6 Ko) Télécharger le fichier
Origin Files produced by the author(s)
licence

Dates and versions

hal-04403686 , version 1 (18-01-2024)

Licence

Identifiers

Cite

Majd Saleh, Stéphane Paquelet, Pierre Castel, Marc Hoarau, Nico Pallamin, et al.. An Efficient Deep-Learning-Based Solution for the Recognition of Relative Changes in Mental Workload Using Wearable Sensors. 2023 IEEE SENSORS, Oct 2023, Vienna, Austria. pp.1-4, ⟨10.1109/SENSORS56945.2023.10324874⟩. ⟨hal-04403686⟩
26 View
15 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More