Cognitive deficits are common in about one third of patients with amyotrophic lateral sclerosis, a neurological condition leading to progressive impairments in speech and movement abilities. To conduct cognitive tests in patients unable to speak or write a reliable and easy to administer eye-tracking paradigm was developed.
Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disorder with pathological involvement of upper and lower motoneurons, subsequently leading to progressive loss of motor and speech abilities. In addition, cognitive functions are impaired in a subset of patients. To evaluate these potential deficits in severely physically impaired ALS patients, eye-tracking is a promising means to conduct cognitive tests. The present article focuses on how eye movements, an indirect means of communication for physically disabled patients, can be utilized to allow for detailed neuropsychological assessment. The requirements, in terms of oculomotor parameters that have to be met for sufficient eye-tracking in ALS patients are presented. The properties of stimuli, including type of neuropsychological tests and style of presentation, best suited to successfully assess cognitive functioning, are also described. Furthermore, recommendations regarding procedural requirements are provided. Overall, this methodology provides a reliable, easy to administer and fast approach for assessing cognitive deficits in patients who are unable to speak or write such as patients with severe ALS. The only confounding factor might be deficits in voluntary eye movement control in a subset of ALS patients.
Amyotrophic lateral sclerosis (ALS) is a fatal neurodegenerative disorder usually leading to death within 3 to 5 years. In the course of the pathology, patients present with progressive loss of respiratory and bulbar functioning as well as impairments in movement abilities1. It shares some clinical, pathological, and genetic features with frontotemporal dementia2 and it is well documented that about 30% of ALS patients exhibit cognitive deficits3. These deficits are most prominent in the domains of executive function, verbal fluency and language4 and have an influence on survival5, compliance6 and carer burden7. Thus, reliable neuropsychological assessment is crucial in this disease.
Advancing impairments in motor and speech abilities are, however, a limiting factor for thorough evaluation of cognitive abilities in later stages of the disease8. Here, oculomotor based approaches seem to be very promising, as basic eye movement control remains intact for a comparably long time during the course of ALS for the majority of patients9. Eye-tracking parameters itself have been used to gain information about the cognitive status of patients with ALS10 and also correlate with the sequential spreading pattern of ALS11. Eye movement as a means to control cognitive tests in the context of ALS has also been studied in previous works. One study has successfully demonstrated its usability in healthy controls using an oculomotor based version of the Trail-Making Test12, whereas another found it suitable to distinguish between healthy controls and ALS patients based on cognitive performance and to discriminate between cognitively more and less impaired patients13.
The research described here used an oculomotor based methodology to study cognitive impairments in ALS patients, specifically in the domain of executive functioning. Two well validated and commonly used neuropsychological tests were adapted to eye movement control: the Raven's coloured progressive matrices (CPM)14 and the D2-test15. The CPM is a non-verbal instrument used to measure executive and visuospatial abilities as well as fluid intelligence. The D2-test is also a non-verbal tool used to uncover executive dysfunction in the domains of selective and sustained attention and visual processing speed. Both are widely used clinical tools which have been successfully employed in previous studies assessing potential cognitive decline during the course of the disease16 and the neuropsychological status of ALS patients compared to healthy controls17.
The goal of this work was to show the requirements for successful evaluation of cognitive deficits in ALS independent of movement and speech disabilities using a reliable, eye-tracking based version of the CPM and the D2-test. Importantly, the method described here has the potential to be expanded to study other populations of patients with severe motor impairments.
The study was approved by the Ethics Committee of the University of Ulm (Statement No. 19/12) and the protocol described therefore follows their guidelines. All participants gave written informed consent.
1. Stimuli and Testing Environment
2. Running the Experiment
For the purpose of the research presented here, i.e., the development of a reliable oculomotor based neuropsychological assessment for ALS patients, in-house developed software stores the subject's choices of the CPM in a separate file, allowing for manual computation of the percentage of correct answers. For the D2-test, a record of the vertical eye movements is manually analyzed using a threshold of + 5° for detection of a relevant response. Recordings are assigned to each stimulus presentation and percentage of correct answers can subsequently be computed. There are many options available of how data can be analyzed, either based on visual inspection of the eye movements or fully computerized, depending on the neuropsychological tasks used.
Figure 2 shows the good congruency between the oculomotor and the standard version (i.e., applied according to standard protocol using paper versions to be marked with a pencil) of the CPM, in a sample of ALS patients (R² = 0.712; p = 0.001). Figure 3 depicts the results from a comparison between cognitively more and less impaired ALS patients, indicating statistically significant group differences in the CPM (p < 0.001) and the D2-test (p = 0.024)13. This further confirms the usability of this technique as it reliably distinguishes between more and less cognitively impaired ALS patients.
Figure 1. Illustration of Eye-tracking Based CPM. Example of the CPM selection procedure as displayed on the participants screen (upper panel) with its corresponding traces of horizontal (upper line) and vertical (lower line) eye positions (lower panel); a scale bar indicating time is given on the bottom of the Figure. When the subject has mentally decided for a choice, movement of a green frame along the presented alternatives of missing pieces which is triggered by a prolonged blink of the subject (A). Selection of one alternative of a missing piece is performed by another prolonged blink of the subject (B). Subsequently, presentation of subject's choice appears separately and confirmation of the choice is done via closing the subject's eyes for at least 250 msec (C). Modified from Keller et al. 201513. Please click here to view a larger version of this figure.
Figure 2:. Congruency between Oculomotor and Standard Version of the CPM. Correlation between results from the standard and the oculomotor condition of the CPM. Given is the percentage of correct answers in the oculomotor (x-axis) and the standard paper-pencil (y-axis) condition of the CPM in ALS patients (R² = 0.712; p = 0.001). Please click here to view a larger version of this figure.
Figure 3. Comparison Between More and Less Cognitively Impaired Patients. Subjects were divided into more and less cognitively impaired according to a median split on their results in the Edinburgh Cognitive and Behavioural ALS Screen (ECAS)19, a standard tool for neuropsychological assessment in ALS patients. Shown are boxplots depicting the percentage of correct answers in the eye-tracking versions of the CPM and the D2-test for both groups. The error bars indicate the highest and lowest percentage scored. Modified from Keller et al. 201513. Please click here to view a larger version of this figure.
PARAMETER | VALUE |
Cameras | 2 |
IR LED Wavelength | > 850 nm |
Total Head Mount Weight | 60 g |
Sampling Rate | 220 Hz |
Spatial Resolution | 0.05° - 0.1° |
Noise Level | 0.015° |
Accuracy | 1° |
Distance Camera-Eye | ~ 50 mm |
Table 1: Specifications of the Videooculography System. Important parameters and their respective values of the system used.
It is a challenging task to successfully assess the cognitive status of patients with ALS who are unable to speak and write. The use of videooculography systems provides a promising approach. The hereby presented technique is reliable in detecting cognitive deficits, which play a pivotal role in the context of carer burden and disease management20 in ALS patients. Also, the oculomotor versions of the CPM and the D2-test correlate significantly with their respective standard paper-pencil versions, but further support is needed to claim the usefulness in a clinical context.
The researcher needs to make sure that eye movement recordings are as noise free as possible to allow for sufficient data quality. Therefore, it is important for researchers to select an eye movement recording device with an appropriate sampling rate. Usually, sampling rates range between 50 Hz and 1,000 Hz. In general, the more subtle oculomotor measurements are required for the task, the higher temporal resolution needs to be used. It needs to be yielded that higher sampling rates usually require a larger restriction of head movement. Also, to allow for a higher sampling rate, researchers may record the movement of just one eye. Another important parameter is spatial accuracy, which is expressed in degrees of visual angle and in this work is 0.05° – 0.1°, depending on pupil size. Again, the higher the demands on visual accuracy in the task the better spatial resolution needs to be. Furthermore, a major issue in quality of the obtained oculomotor data is head movement, which has to be restricted to a tolerable minimum. Most eye-tracking studies use a chin rest and/or a head mounted device. If possible, combine both options as this restricts head movement and its accompanying confounds most. However, this is not possible in all patients, e.g., patients with very serious physical impairments, and might then be altered according to the subject's capacities. It should also be noted that newer devices, which calculate the eye position via a small stationary camera placed in front of the subject underneath the screen on which stimuli are presented, do not require goggles or a chin rest, while also sufficiently correcting for head movements.
The cognitive tests are interchangeable with other standard neuropsychological tests, depending on the cognitive domain one is interested in. To use other tests in ALS patients, they just need to be adapted to a format in which answers can be given using eye movements. Especially given the rapid technological advance in the field of eye-tracking, further increasing acuity, flexibility and handiness, this methodology might also be suited for a large variety of cognitive research questions in different clinical samples.
Some patients might be too impaired in their cognitive abilities to correctly understand the instructions of the tasks used in this study. One other serious limitation for the use of eye-tracking technologies in ALS patients are potential oculomotor abnormalities, or even complete loss of eye movement control, previously reported in patients with the disease21,22. These abnormalities are very subtle in early stages of the disease and sequentially impact more basic oculomotor functions in the progress of ALS pathology11.
The protocol presented here is therefore only suited for those ALS patients unable to speak and write but still able to control their eye movements. This however encompasses a comparably large group, for which reliable information about cognitive status is crucial23. For patients with no satisfactory eye movement control or ability to blink, this protocol is not suited. However, another hand and speech-motor free way to assess cognitive function in these cases is brain-computer interface control, as has been done in recent work24.
The technique presented here is fast, easy to administer, user-friendly and potentially allows clinicians and researchers to perform neuropsychological assessments with patients who are severely physically impaired and therefore not able to undergo paper-pencil based testing anymore, such as – but not necessarily limited to – patients with ALS, using an eye-tracking device.
It provides an opportunity to gain information about potential cognitive deficits in patients with complete paralysis, i.e., information which then plays a critical role in the context of life prolonging therapeutic treatments and end-of-life decision making in ALS6,25.
In the future, mobile devices with high acuity and head movement tolerability which can be handled more flexibly might be used to comfortably assess cognition in immobile patients at their bedside, eliminating the need for a special testing environment. Also, the use of other, possibly more sophisticated eye-tracking controlled experimental procedures is needed to assess more subtle cognitive deficits in severely impaired patients.
The authors have nothing to disclose.
The authors would like to thank Ralf Kühne for technical support. This work was funded by the Deutsche Forschungsgemeinschaft (DFG) and the Bundesministerium für Bildung und Forschung (BMBF #01GM1103A). This is an EU Joint Programme-Neurodegenerative Disease Research (JPND) project. The project is supported through the following organizations under the aegis of JPND-e.g., Germany, Bundesministerium für Bildung und Forschung (BMBF, FKZ), Sweden, Vetenskaprådet Sverige, Poland, Narodowe Centrum Badań i Rozwoju (NCBR).
EyeSeeCam | EyeSeeTec GmbH; 82256 Fürstenfeldbruck, Germany | Videooculography device |