Assessing the Multiple Dimensions of Engagement to Characterize Learning: A Neurophysiological Perspective

Summary

This paper aims to describe the techniques involved in the collection and synchronization of the multiple dimensions (behavioral, affective and cognitive) of learners’ engagement during a task.

Abstract

In a recent theoretical synthesis on the concept of engagement, Fredricks, Blumenfeld and Paris¹ defined engagement by its multiple dimensions: behavioral, emotional and cognitive. They observed that individual types of engagement had not been studied in conjunction, and little information was available about interactions or synergy between the dimensions; consequently, more studies would contribute to creating finely tuned teaching interventions. Benefiting from the recent technological advances in neurosciences, this paper presents a recently developed methodology to gather and synchronize data on multidimensional engagement during learning tasks. The technique involves the collection of (a) electroencephalography, (b) electrodermal, (c) eye-tracking, and (d) facial emotion recognition data on four different computers. This led to synchronization issues for data collected from multiple sources. Post synchronization in specialized integration software gives researchers a better understanding of the dynamics between the multiple dimensions of engagement. For curriculum developers, these data could provide informed guidelines for achieving better instruction/learning efficiency. This technique also opens up possibilities in the field of brain-computer interactions, where adaptive learning or assessment environments could be developed.

Introduction

Engagement plays a crucial role in learning. For Clark and Mayer², “all learning requires engagement,” regardless of delivery media. Zhang et al.³ also suggested that increased student engagement can improve learning outcomes, such as problem solving and critical thinking skills. Defining engagement remains a challenge. In their literature review, Fredricks, Blumenfeld and Paris¹ defined engagement by its multifaceted nature: “Behavioural engagement draws on the idea of participation; it includes involvement in academic and social or extracurricular activities. (…) Emotional engagement encompasses positive and negative reactio....

Protocol

This protocol received an ethical certificate from the Comité institutionnel de la recherche avec des êtres humains (CIER) de l’Université du Québec à Montréal (UQAM) that was endorsed by HEC-Montreal for the Tech3Lab research facility. The protocol describes each of the specific steps that are performed in our lab environment and equipment. Although precise software paths are provided to clarify the methodology, this technique is transferable and can be replicated with other proprietary eye-tracking, automatic facial emotion recognition, electrodermal activity and electroencephalography equipment and software.

Results

Figures 2 and 3 show screenshots of the results of the integration and synchronization of behavioral, emotional and cognitive engagement data in a behavioral analysis software application. In both figures, the left-hand section organizes the research subjects and the coding scheme. In the middle section, a video (with red dots) shows the subject’s eye gaze during the task. The subject’s behavioral engagement can be inferred based on what he/she is looking at during the task and what actions are taken. In.......

Discussion

In terms of critical steps within the protocol, it should first be pointed out that data quality is always the main focus for neurophysiological collection techniques. In this methodology, research assistants must pay special attention to instructing the subjects to minimize head movements that will interfere with valence monitoring (losing correct face angle for the camera) or generate myographic artifacts in the EEG. On the other hand, a balance must be maintained between the authenticity of real problem solving and in.......

Materials

List of materials used in this article

Name	Company	Catalog Number	Comments
EGI GSN-32	EGI		Dense array EEG
Netstation v.5.0	EGI		EEG data collection software: EEG is collected with 32-electrode dense array electroencephalography (dEEG) geodesic sensor net using Netstation acquisition software and EGI amplifiers (Electrical Geodesics, Inc). The vertex (recording site Cz) is the reference electrode for recording. Impedance is kept below 50 kΩ with a sampling rate of 250 Hz.
Facereader v.4	Noldus		Facial emotion recognition software
Syncbox	Noldus		Syncbox start the co-registration of EEG and gaze data by sending a Transistor-Transistor Logic (TTL) signal to the EGI amplifier and a keystroke signal to the Tobii Studio v 3.2.
Logitech C600  Webcam		960-000396	Webcam used to gather video data sent to mediarecorder and that will be analyzed in Facereader
The Observer XT	Noldus		Integration and synchronization software: The Noldus Observer XT (Noldus Information Technology) is used to synchronize all behavioral, emotional and cognitive engagement data.
On-Screen LED illumination	Noldus		Neon positioned on computer screen in order to correctly light the face of subjects
MediaRecorder	Noldus		Video data collection software
Tobii 60X	Tobii		Collect eye-movement patterns :  used to record subjects’ eye movement patterns at 60Hz during the experiment.
Tobii Studio v.3.2	Tobii		Eye-tracking data collection and analysis software
Analyzer 2	Brainvision		EEG signal processing software
Acqknowledge v.4.0	Biopac	ACK100M	Physiological signal acquisition and processing software
Control III germicide solution	Maril Products.	10002REVA-20002-1	Disinfectant solution used with EEG helmets : recommended by EGI
Unipark	QuestBack AG		Online survey environment