Method Article

A Gaze-Contingent Display Framework for Perceptual Learning Research with Simulated Central Vision Loss

DOI:

10.3791/67596

⸱

April 11th, 2025

 ,  ,  ,  ,  ,  ,  ,  , 
1Department of Psychology, University of California, Riverside, 2Civitan International Research Center, University of Alabama at Birmingham, 3Department of Neurobiology, Heersink School of Medicine, University of Alabama at Birmingham, 4Department of Psychology, Northeastern University, 5Department of Occupational Therapy, University of Alabama at Birmingham

In This Article

Summary

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

We present development of a gaze-contingent display framework designed for perceptual and oculomotor research simulating central vision loss. This framework is particularly adaptable for studying compensatory behavioral and oculomotor strategies in individuals experiencing both simulated and pathological central vision loss.

Abstract

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Macular degeneration (MD) is one of the leading causes of vision impairment in the Western world. Patients with MD tend to develop spontaneous eye movement strategies to compensate for their vision loss, including adopting a preferred retinal locus, or PRL, a spared peripheral region that they use more frequently to replace the damaged fovea. However, not all patients are successful in developing a PRL, and even when they do, it might take them months. Currently, no gold standard rehabilitative therapy exists, and MD research is further hindered by issues of recruitment, compliance, and comorbidity. To help address these issues, a growing body of research has used eye tracking-guided, gaze-contingent displays in a simulated central vision loss paradigm in individuals with intact vision. While simulated vision loss is qualitatively different than pathological central vision loss, our framework provides for a highly controlled model through which to study compensatory eye movements and test possible rehabilitation interventions in low vision. By developing a comprehensive framework, rather than relying on isolated and disconnected tasks, we create a cohesive environment where we can test larger-scale hypotheses, allowing us to examine interactions between tasks, assess training effects across multiple measures, and establish a consistent methodology for future research. Furthermore, participants in simulated central vision loss studies show similarities in their oculomotor compensatory behaviors compared to patients with MD. Here, we present a framework for conducting gaze-contingent studies related to simulated central vision loss. We emphasize the utilization of the framework to test behavioral and oculomotor performance of healthy individuals on a wide range of perceptual tasks encompassing different levels of visual processing. We also discuss how this framework can be adapted for training MD patients.

Introduction

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Macular degeneration (MD) is the main cause of vision impairment globally, and it is projected to affect 248 million people worldwide by 20401. Late-stage MD is characterized by damage to the photoreceptors in the center of the visual field (fovea). Loss of central vision has severe effects on daily tasks that rely on central vision, such as navigation2, reading3, and recognizing faces4. Consequences of MD greatly impact the quality of life of these individuals5 and lead to negative psychological consequences6. Patients with MD, deprived of their central vision, may spontaneously develop compensatory oculomotor strategies involving the use of a peripheral retinal region to replace the fovea (Figure 1). This region, referred to as the preferred retinal locus (PRL)7, is often adopted by patients in tasks involving fixation, reading, and face recognition. There is evidence of the PRL, in patients with MD, taking over oculomotor referencing duties of the fovea8,9. Further, changes in attention and cognitive control are observed in patients with central vision loss, suggesting a relationship between vision loss and cognitive functions10. 

Macular degeneration effects diagram showing healthy vision, central loss, and preferred fixation.
Figure 1. Illustration of the perceptual experience of individuals with healthy vision and macular degeneration patients with foveal scotoma. Foveal scotoma leads to central vision loss in patients with macular degeneration. Some individuals can partially compensate for the loss of visual input to the fovea by using a peripheral retinal location, defined as  preferred retinal locus (PRL). In patients that developed a PRL, this is often used for eccentric fixation and during daily tasks. Retinal location, shape and size of the PRL can vary from person to person. Please click here to view a larger version of this figure.

While no gold standard intervention exists to recover vision loss or to compensate for loss of central vision, experimental approaches from optometry, occupational therapy and vision science are being tested to improve compensation through peripheral vision11,12. Oculomotor approaches focus on teaching patients to improve eye movement control and coordination, including teaching them to use a more adequate PRL11,12,13,14,15 while perceptual interventions focus on improving the general peripheral visual abilities or vision within the PRL, partially overcoming the limitation of peripheral vision16,17,18,19,20. Recent studies have used an eye-tracking based gaze-contingent display as a paradigm for the study of eye movements in central vision loss21,22,23,24,25,26,27,28,29. This approach, which utilizes a simulated scotoma (i.e., an occluder to obstruct the central region of the visual field) in healthy individuals (Figure 1), mitigates issues of recruitment and compliance, while providing high control on several parameters, such as the size and shape of the scotoma, thereby offering a promising alternative to the direct involvement of patients with MD. While there exists several differences between central vision loss and simulated scotoma30,31, some of the oculomotor behavior observed in the former, such as the development of a PRL, can be seen in the latter27,30,32, suggesting that some aspects of compensatory oculomotor strategies can be elicited by this gaze-contingent paradigm. Importantly, simulated central vision loss provides a broad framework for studying plasticity in both the healthy visual system and following central vision loss.

Here, we present the design, development, and use of a gaze-contingent framework that can be used to test perceptual, oculomotor, and attentional performances in healthy individuals and, with some modifications, in MD patients (Figure 2). We also detail the technical and psychophysical considerations that accompany gaze-contingent, peripheral training. A key technical challenge involves creating the perception of a smooth, short latency movement of the scotoma33. This short latency is obtained by selecting appropriate display devices, eye trackers, and operating systems34,35,36. Previous work has documented how each piece of hardware adds latency37 and strategies to reduce overall latency, accommodate blinks, and slow eye movements33. A novel aspect of our paradigm is the diverse set of training and assessment tasks within a single framework for perceptual research in both healthy and patient populations. The framework characterizes multiple levels of visual processing affected by central vision loss, specifically low-level vision, higher-level vision, attention, oculomotor control, and cognitive control. Preliminary tests conducted using a modified version of this approach showed evidence of improvement in visual acuity in both healthy controls and the patient population32. 

Brain functions and visual processing tasks diagram; oculomotor control, attention, cognitive control.
Figure 2. Multidimensional approach to the study of plasticity in the visual system, and vision rehabilitation in Macular Degeneration. Illustration of interconnected dimensions such as visual perception, oculomotor, and cognitive control that contribute to visual processing and are affected in central vision loss. Please click here to view a larger version of this figure.

Protocol

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

All participants were healthy individuals with visual acuity of 20/40 or above and no known vision issues. Both the representative participants are females, and their ages are 27 and 24. All participants provided informed consent, and the study received approval from the Institutional Review Board (IRB) at the University of Alabama at Birmingham.

1. Identifying an ideal system for simulated central vision loss research

  1. Identify a system that efficiently transmits information from the eye tracker to the stimulus generation software in a continuous loop. Use methods described in37 to measure the latency of different combinations of systems to identify the one with the lowest latency.
    ​NOTE: A comparison of the combined latency of four different combinations of systems comprising two eye trackers (EyeLink 1000 Plus Tower Mount and TRACKPixx3), two display devices (CRT Monitor (refresh rate = 100Hz) and Display++ (refresh rate = 120Hz)) along with two operating systems (Windows 10 and Mac iOS) is shown in Figure 3. Each combination was measured 20 times. Results showed that system latency was the lowest when Vpixx TrackPixx3 eye tracker was used in combination with the Windows 10 operating system.

System latency comparison chart; bar graph, different setups, error bars, performance analysis.
Figure 3: Latency comparison across different combinations of monitors, eye-tracking devices, and operating systems. Bars represent the ± 1 standard deviation across the 20 repetitions per combination. Measures were taken with a Mac operating system phone in slow motion mode, reaching a refresh rate of 240Hz. TP/CRS/Win is statistically different from E1000/CRT/Mac (t(38)=9.53, p<0.001), E1000/CRS/Mac (t(38)=16.24, p<0.001) and E1000/CRS/Win (t(38)=3.94, p<0.001). Please click here to view a larger version of this figure.

2. Participant familiarization with simulated central vision loss through gaze-contingent display

NOTE: A fundamental component in simulating central vision loss is to familiarize participants with the gaze-contingent display. Without proper familiarization, measures of abilities can be conflated by the participants' effort to navigate the gaze-contingent display. Several key steps in the protocol ensure sufficient familiarization with the gaze-contingent display to be able to measure visual performance reliably.

  1. Provide participants with audiovisual instructions about the task that they will be performing during a particular session. For each task, have dedicated video instructions with screen captures from the actual task. Then, explain the instructions verbally to ensure that the participant has a good understanding of what to expect in a given task.
  2. Provide participants with practice trials before beginning each of the main tasks. This provides an opportunity to clarify any questions related to the task.
  3. During the initial visit, before conducting gaze-contingent tasks, carry out fixation training on participants, where they learn to place their simulated scotoma within a white central box on the screen for varying durations with spatial tolerance increasing across trials, while they ignore distractors that may appear on the screen.
  4. Additionally, carry out a PRL induction task on participants, which is designed to promote the development of PRL-like behavior. In this task, make participants view an opaque disk randomly placed on the screen that covers a target (for example, a Landolt C) and move the scotoma close to the opaque disk to reveal the target.
    NOTE: Oculomotor analysis of this task can indicate an early PRL-like location that can later be used as a training locus. In this experimental paradigm, the circular central scotoma subtended 10° visual angle. These steps allow participants to familiarize themselves with the gaze-contingent display and prepare them to perform a wide range of perceptual assessments and training tasks using their peripheral vision.

3. Development of effective instructions

NOTE: Instructions play a crucial role in guiding participants on how to respond to stimuli and manage their simulated scotoma during different tasks. Appropriate instructions must be thorough and clear to avoid any confusion. Instructions should be reiterated as needed to ensure understanding.

  1. Instructional videos
    1. Visual demonstration: Provide videos that visually demonstrate each step of the task. Videos should clearly illustrate how to manage the simulated scotoma appropriately during the task and how to respond to stimuli.
    2. Narration: Deliver a concise script developed to accompany the visual demonstration that explains the process in simple terms. Ensure that language is easy to understand and avoid technical terminology.
  2. Scripted verbal instructions
    1. Consistency: Use a standardized script for verbal instructions to ensure consistency across different sessions and participants. Example: Throughout the task, there will be multiple breaks to rest your eyes. During these breaks, make sure to keep your head on the chin rest. When you are ready to continue the task, press the spacebar, and the task will begin again.
    2. Clarity: Speak slowly and clearly - make sure to emphasize all important aspects of the task.
  3. Visual instructions
    1. On-screen instructions: Provide written guidance on the screen that participants can read before and during the completion of tasks. Use short sentences for clarity with visual aids to demonstrate stimuli that the participant may encounter during each task.

4. Assessment tasks' design and implementation

NOTE: Tasks designed within this framework are broadly divided into two main categories: (1) Free eye movement tasks and (2) Fixation-constrained tasks. In the free-eye movement tasks, let participants make eye movements across the screen to identify targets appearing at random locations on the screen (or to read text), whereas, in fixation-constrained tasks, ask participants to maintain fixation within a central white box throughout the task and use their peripheral vision to make judgments. Figure 4 shows example tasks and descriptions for each category. More detailed information about the tasks can be found in38.

Oculomotor demand table: Free eye movement and fixation tasks, visual skills, attention, and sensitivity.
Figure 4: A visual representation of different assessment tasks designed using the framework. The tasks are broadly categorized into Free eye movement tasks, where the scotoma follows the eye movements of the participants to view targets freely (top panel), and Fixation-constrained tasks, where the scotoma needs to be placed within a central white box throughout the task (bottom panel). This figure has been modified from38. Please click here to view a larger version of this figure.

  1. Free eye movement tasks
    NOTE: Free eye movement tasks measure participants' eye movement behavior while they perform tasks. These promote understanding of the eye's movements in the context of naturalistic tasks such as reading and visual search.
    1. Instructional video/verbal instructions
      1. Present an instructional video and scripted verbal instructions to the participant prior to the calibration.
    2. Calibration
      1. Run validations of previous calibrations between tasks and additional calibrations when validations are poor, or when participants take breaks between tasks.
    3. Free-viewing task specific methods
      1. Perform free-viewing tasks that instruct participants to do a variety of actions using their gaze rather than fixating on one area. Choose to perform the task with one of the following variants.
      2. Bring the scotoma near a cue, causing a stimulus to appear. Maintain fixation on a specific screen location for a period of time. Perform a standard task, like reading or visual search, with central vision occluded by the scotoma.
      3. At the beginning of tasks, provide participants with on-screen instructions followed by a set of practice trials. Following the completion of the practice trials, give reminder instructions before moving on to the task. Ensure that the participants understand and have shown proficiency using the visual layouts, the required oculomotor actions, and the response characteristics of each task prior to measuring performance.
      4. Provide participants with auditory feedback indicating the accuracy of their responses as they complete each task, as visual feedback can be missed due to the use of a scotoma.
      5. Incorporate breaks of up to 1 min into each task to reduce the chance of testing fatigue. Incorporate breaks of 3 min or longer for days that include longer sessions of assessments to reduce the chances of testing fatigue.
  2. Fixation-constrained tasks
    NOTE: Fixation-constrained tasks are useful to test or train peripheral vision at specific visual field locations. These tasks are suitable for testing both early- and mid-level visual processing, including visual acuity, contrast sensitivity, crowding, etc., as well as high-level visual processing, including exogenous and endogenous attention. For these tasks, it is important that participants learn to maintain steady fixation to avoid task performance being confounded by attentional resources dedicated to steady fixation. During these tasks, participants are asked to keep their central vision focused on the center of the screen with the help of fixation aids (Figure 5B) while responding to stimuli that appear in their peripheral vision.
    1. Instructional video/verbal instructions
      1. Present an instructional video and scripted verbal instructions to the participant prior to the calibration.
    2. Calibration
      1. Run validations of previous calibrations between tasks and additional calibrations when validations are poor, or when participants take breaks between tasks.
    3. Fixation-constrained task-specific methods
      1. During fixation-constrained tasks, ask participants to maintain their head position in the chinrest for the duration of the task, ensuring that the calibration remains as accurate as possible to the original position throughout the process.
      2. Provide participants with on-screen instructions followed by a set of practice trials. Following the completion of the practice trials, give a reminder set of on-screen instructions before moving on to the task.
      3. During these tasks, ask participants to keep their central vision focused on the center of the screen with the help of fixation aids (white rectangular fixation box) while responding to stimuli that appear in their peripheral vision to either side of the fixation box.
      4. Ask participants to respond using their right index finger on a five-button response box located to their right during the assessment. If fixation is not maintained, the stimulus will not be presented and will time out unless fixation is resumed.
      5. Provide participants with auditory feedback indicating the accuracy of their responses as they complete each task, as, again, visual feedback can be missed due to the use of a scotoma.
      6. Incorporate breaks of up to 1 min into each task to reduce the chance of testing fatigue. Incorporate breaks of 3 min or longer for days that include longer sessions of assessments to reduce the chances of testing fatigue.
  3. Development of appropriate fixation displays
    NOTE: Tasks involving peripherally presented targets and simulated scotoma obstructing central vision present challenges when trying to estimate performance in a retinotopically defined location. Indeed, even in foveal tasks, the eyes make small, involuntary movements in the form of drift and microsaccades). Thus, in order to optimize fixation stability, careful thought should go into designing fixation aids.
    1. Develop a fixation aid design that incorporates both a large fixation cross and a fixation box (Figure 5). Instruct participants to maintain the opaque occluder within the fixation box and use the long arms of the fixation cross as a reference for the center of the screen.
      NOTE: This design combines both bullseye- and crosshair- types of visual aids, which have been shown to lead to the best fixation stability39. Additionally, by having both a fixation box and a fixation cross, this design can be easily used in translational contexts to test patients with central vision loss, as is the case of patients with MD.
  4. Optimization of adaptive procedures to accurately measure performance
    NOTE: A critical aspect of implementing different assessments is the ability to quickly and successfully estimate performance thresholds in a subset of these tasks (specifically visual acuity, contrast sensitivity, crowding, and contour integration). A challenge is that conventional staircases can be slow to converge and target performance close to the threshold, causing frustration and fatigue. To circumvent this, we implemented a three-stage procedure to estimate the performance of participants in these tasks.
    1. In the first stage, ask participants to perform 12 practice trials before the actual experiment. During the second stage, utilize a 2-down 1-up staircase that terminates after 3 downward reversals (i.e., the direction of stimulus change, from down (hard) to up (easy), also refer to representative results section), followed by the third stage that consist of a conventional 3-down 1-up staircase that ends after 60 trials.
      NOTE: Pilot studies indicated that this procedure achieves reliable thresholds for most tasks (visual acuity, crowding, and contrast sensitivity tasks). However, some tasks can require other methods, especially when performance can differ greatly across participants. For example, in the contour integration task, after the first stage of the procedure (practice), an additional procedure was implemented. The difficulty of the task was manipulated using a progressive staircase method where the orientation jitter (0°, 1°, 2°, 4°, 6°, 8°, 10°, 12°) increased every three trials for a total of 24 trials. Then, the second and third stages of the procedure (adaptive staircase) continued as normal. In general, different tasks may require slightly different adaptive procedures. However, the 3-stage approach allows participants to practice and quickly get within range of their threshold and provides detailed measurement within that range.

Optical illusion diagram, static equilibrium concept, visual perception study, symmetry analysis.
Figure 5: Fixation aids used to promote fixation stability in participants. (A) Fixation cross and fixation box were used for fixation stability tasks. (B) The fixation cross, fixation box, and black cross at the center were used in low-level vision tasks. Please click here to view a larger version of this figure.

Results

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

In this section, we present illustrative data from both free eye movement and fixation-constrained tasks. The goal of this section is to illustrate data obtained using the framework and its ability to measure peripheral visual functions. The section is organized into four distinct categories, each highlighting critical elements necessary for accurate visual performance estimation under simulated central vision loss. These categories include performance on (1) low- and mid-level vision tasks, (2) attention measures in high-level vision tasks, (3) ecologically valid tasks, and (4) oculomotor metrics that capture adaptive eye movement strategies when central vision fixation is obstructed. All participants were healthy individuals with visual acuity of 20/40 or above and no known vision issue. Both of our representative participants were females and their ages are 27 and 24. All participants provided informed consent, and the study received approval from the Institutional Review Board (IRB) at the University of Alabama at Birmingham.

Performance on low and mid-level vision tasks with adaptive staircases

Figures 6 and 7 illustrate the performance progression of two participants across four specific visual tasks: visual acuity (Panel A), contrast sensitivity (Panel B), contour integration (Panel C), and crowding (Panel D). The performance trajectories are represented using color-coded staircases, where green denotes the left location of the target and purple signifies the right location. For each task, thresholds were calculated by averaging the last six reversals for each location (and for each shape or orientation in the contour integration and crowding tasks, respectively). These thresholds are marked by a dotted line perpendicular to the y-axis. It is important to note that for the visual acuity, contrast sensitivity, and crowding tasks, lower values on the y-axis correspond to better performance, whereas for the contour integration task, higher values indicate superior performance.

Visual acuity, contrast sensitivity, contour integration, and crowding tasks; graphs of trial results.
Figure 6. Performance of Participant 1 across tasks utilizing adaptive staircases: Panels A, B, C, and D correspond to the participant's performance on the visual acuity, contrast sensitivity, contour integration, and crowding tasks, respectively. Performance on the left location is marked by red dots, while performance on the right location is denoted by black dots. The thresholds for each task are represented by dashed lines perpendicular to the y-axis. Please click here to view a larger version of this figure.

Participant 2 visual tasks; visual acuity, contrast sensitivity, contour integration, crowding graphs.
Figure 7. Performance of Participant 2 across tasks utilizing adaptive staircases: Panels A, B, C, and D correspond to the participant's performance on the visual acuity, contrast sensitivity, contour integration, and crowding tasks, respectively. Performance on the left location is marked by red dots, while performance on the right location is denoted by black dots. The thresholds for each task are represented by dashed lines perpendicular to the y-axis. Please click here to view a larger version of this figure.

Participants showed reliable performance in visual acuity, contrast sensitivity, contour integration and crowding tasks during the experiment (Figure 6 & 7).

Measures of Attention

Figure 8 illustrates the participants' performance on the exogenous attention task, where reaction times are measured for congruent (valid cue) and incongruent (invalid cue) trials, categorized by location (left/right). For Participant 1, a significant effect of cue type was observed at the left location (Welch’s t-test: t(111.5) = -2.6, p < 0.05), indicating a notable difference in reaction times based on cue congruency (Figure 8). However, no significant effect was found at the right location. For Participant 2, there was no significant effect of cueing observed at either location. Figure 8 shows consistent cueing effect, as expected in an exogenous attention task.

Reaction time and accuracy bar charts; cognitive task performance comparison for two participants.
Figure 8. Exogenous Attention Task Analysis: The figure presents the reaction times (measured in seconds) of two participants, with data grouped according to the location of target presentation. In this visualization, blue bars represent reaction times and percent accuracy for congruent and incongruent trials. Error bars are included to indicate the standard deviation for each condition. Upper graphs show reaction times and accuracy rate on the left side, lower graphs show reaction times and accuracy rate on the right side. Please click here to view a larger version of this figure.

Performance on Free Eye Movement Tasks

Performance on the MNRead task is measured by the time taken to read each sentence, with the task concluding when the participant can no longer read the sentence. Figure 9A and B display the MNRead task performance for both participants. As anticipated, the time required to read each sentence increases as the font size decreases. From these results, we can estimate key metrics such as reading acuity (the smallest font size correctly read), maximum reading speed, and the critical print size (the smallest print size at which participants can read at their maximum speed). These metrics can be compared both within and between participants. Figure 9C illustrates performance on the Trail Making Task, with total completion time recorded for both Part A (connecting numbers in ascending order) and Part B (connecting alternating numbers and letters in sequential order). Despite having the same number of elements, participants generally take longer to complete Part B, a finding consistent with previous research43.

MNRead and Trail Making Task graphs; response time vs. font size and elements; cognitive evaluation.
Figure 9. Analyses of ecologically valid assessment tasks: The response time (measured in seconds) as a function of sentence font size is presented for Participant 1 in Panel A and for Participant 2 in Panel B. Panel C illustrates the time to completion (in seconds) for both Part A and Part B of the Trail Making Task. In this figure, blue bars represent the performance of Participant 1, while red bars correspond to the performance of Participant 2. Please click here to view a larger version of this figure.

Eye Movement Analysis

To understand peripheral viewing strategies after visual training, we analyze fixation distributions to estimate fixation stability and the location of the PRL44,45. The dispersion of eye positions within a trial is analyzed by controlling for varying fixation locations across different trials. This approach allows for the calculation of the average dispersion of eye positions within each trial. This metric is a within-trial measure of the dispersion of eye positions after the first fixation of the trial, consistent with previous studies27,28. Moreover, perceptual training of healthy vision individuals by using gaze-contingent display leads to shorter saccade latency46. We analyze peripheral fixation behavior by calculating dispersion through determining the Bivariate Contour Ellipse Area (BCEA), which encompasses a specified percentage of fixations, typically 68%, over a certain time period (e.g., 15-30 seconds). Unlike previous studies, we normalized the dispersion of fixations for each trial-by-trial duration and then averaged this across all trials (as shown in Figure 10, column 2). This normalization ensures that even if fixations are centered in different locations across trials, the method plots all distributions at a common reference point. Additionally, we employed a probability density analysis using Kernel Density Estimation (KDE) to visually represent areas with a high density of fixations (Figure 10, column 3). This technique allows us to define PRL as the region corresponding to the peak of the KDE function. It is important to note that these analyses offer a general overview of participants' gaze patterns over time but do not distinguish between how gaze patterns vary from trial to trial.

BCEA and KDE graphs; fixation density analysis for participants; visual acuity assessment results.
Figure 10. Fixation Stability Analysis: The figure displays BCEA and KDE plots of fixation distributions for the two participants. In the BCEA plots, a blue ellipse encloses 68% of the total fixations. In the KDE plots, the bright yellow area indicates the region with the highest fixation density. Please click here to view a larger version of this figure.

Supplemental File. Please click here to download this File.

Discussion

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

In this methodological paper, we present a gaze-contingent framework for conducting perceptual research in simulated central vision loss that emphasizes hardware, design, and methodological considerations that are required to (1) choose the shortest system latency for gaze-contingent display, (2) administer a wide range of visual perception tasks, and (3) measure the oculomotor and perceptual performance of participants within this paradigm. Concerning (1), we emphasize the need for testing hardware and software reliability in maintaining the perception of gaze contingency. Specific combinations of eye tracker equipment and computer software and hardware, ideally more than one, should be tested to ensure that the latency is low enough not to disrupt the perception of contingency and, importantly, not to allow participants to exploit the system delay to perform tasks with their fovea. Concerning (2), we implemented several checks when designing tasks (and subsequently collecting data) using gaze-contingent displays. A key aspect is ensuring that participants become familiar with the modified viewing conditions introduced by the scotoma. This involves training them to maintain stable fixations, which is essential for fixation-dependent tasks, and initiating appropriate oculomotor behavior, both of which are crucial for successfully completing perceptual tasks. We achieve this by training participants to fixate with the scotoma and using a PRL induction task prior to use of the perceptual tasks. Concerning (3), we have a detailed framework for each task including set-up, instructions, practice, and adaptive methods addressing both free-viewing and fixation-controlled tasks. A distinctive feature of our framework is its capacity to accommodate a broad spectrum of perceptual tasks, designed to assess performance at various levels of visual processing, including low-, mid-, and high-level tasks. To accurately measure performance, it is essential to incorporate adequate breaks both within and between tasks, and to structure the psychophysical demands so that performance can be assessed efficiently and reliably. This approach minimizes fatigue, particularly in participants with intact central vision, who may otherwise experience strain from extended use of their visual periphery. Finally, we introduce methods to analyze eye-movements within-trials by calculating the BCEA encompassing a given percentage of fixations over a certain period to quantify oculomotor behavior representative of different peripheral-looking strategies of participants.

Using simulated central vision loss as a model to test the specificity and generalization of perceptual learning

The rationale for using simulated central vision loss is twofold: (1) it provides a controlled environment to test the training strategies and assess how learning transfers to other untrained tasks and locations, and (2) effective use of peripheral vision requires enhancement across multiple levels of visual processing, including low-, mid-, and high-level vision. Our goal is to investigate how these different visual domains evolve together through perceptual learning following central vision loss. By measuring a range of learning outcomes, we aim to characterize distinct learning profiles and patterns of generalization across various outcome measures.

Although not exhaustive, the proposed training strategies encompass all three domains of visual processing, addressing fundamental aspects of vision that are known to be, at least partially, separable from both visual performance and neuroscientific perspectives. In this study, participants undergo 20 training sessions, each lasting approximately 45 minutes, on one of four training tasks assigned randomly. Before training begins, each participant's specific preferred retinal locus (PRL) is identified through the PRL induction task, and this locus is then used as the trained retinal locus (TRL) during the training. Baseline and post-training performance on various assessment tasks are measured to observe whether learning transfers to other tasks and untrained locations (i.e., locations other than the TRL). Additionally, we examine pre- and post-training changes in eye movement metrics across these tasks.

Limitations

While this framework is currently utilized to train and assess performance in both individuals with healthy vision (using simulated scotomas) and patients with macular degeneration (MD), there are several limitations that warrant consideration. In our study, we employ a visible scotoma, which may lead to compensatory eye movements or other strategies that might not occur with a real-world, invisible scotoma. Additionally, the use of a static scotoma, as opposed to dynamic scotomas that can change and grow in shape and size (as seen in patients), limits our ability to study the longitudinal effects of central vision loss. However, it is feasible to monitor the physical properties of a scotoma in patients, such as size and shape, using microperimetry. Further, it is possible that the uniform background of scotoma leads to adaptation effects, and future research should examine use of non-uniform backgrounds. Furthermore, while we simulate central vision loss using computer displays, it is also crucial to examine its effects in more naturalistic settings. Extended reality (XR) systems offers the potential to provide a more immersive and subjective experience of simulated central vision loss for individuals with healthy vision, but it is essential to carefully consider the latency of such systems to ensure a smooth and realistic perception of the scotoma. Importantly the use of XR could also facilitate use of more naturalistic tasks that could better mimic real-world tasks that people with central vision loss need to navigate.

Conclusion

The proposed framework for using gaze-contingent displays to test vision in the context of simulated central vision loss has broad applicability both for understanding use of peripheral vision after central vision loss and for developing new vision training interventions. The novel multidimensional framework integrates multiple approaches to testing vision both in fixation controlled and free viewing conditions and can support gaze-contingent training interventions. Further aspects of the framework can be extended to address other conditions of retinal or cortically based visual field loss that also rely upon measurement and/or training that targets specific visual field locations in context of vision loss. It can also be translated across technology systems, such as modern extended reality systems, to provide greater accessibility for research and practice addressing low vision.

Disclosures

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors declare that there is no conflict of interest regarding the publication of this paper.

Acknowledgements

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This work is supported by NIH NEI 1 U01 R01EY031589 and 1R21EY033623-01.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
CRT MonitorViewSonic PF817 Professional Series CRT, ViewSonic Corp.https://www.viewsonic.com/us/monitors.html?srsltid=
AfmBOorEmjc67A5U2v2V
wywNRHWzdrxcYx7Q3Y0
9tiNrnbs6FC4TPlc9
Display++ LCD MonitorCambridge Research Systemshttps://www.crsltd.com/tools-for-vision-science/calibrated-displays/displaypp-lcd-monitor/
Eye TrackerEyeLink 1000 Plus Tower Mount, SR Researchhttps://www.sr-research.com/eyelink-1000-plus/
Eye TrackerVpixx Technologies Inc.www.vpixx.com
Macintosh IOSApple Inc.https://www.apple.com/mac/
Windows 10Microsoft Inc.https://www.microsoft.com/en-us/

References

$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,
  1. Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040: a systematic review and meta-analysis. Lancet Glob. Health. 2 (2), e106-e116 (2014).">Wong, W. L., et al. Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040: a systematic review and meta-analysis. Lancet Glob. Health. 2 (2), e106-e116 (2014).
  2. On-road driving with moderate visual field loss. Optom Vis Sci. 82 (8), 657-667 (2005).">Bowers, A., Peli, E., Elgin, J., McGwin, G., Owsley, C. On-road driving with moderate visual field loss. Optom Vis Sci. 82 (8), 657-667 (2005).
  3. Reading and eye movements in age-related maculopathy. Optom Vis Sci. 72 (2), 125-138 (1995).">Bullimore, M. A., Bailey, I. L. Reading and eye movements in age-related maculopathy. Optom Vis Sci. 72 (2), 125-138 (1995).
  4. The role of external features in face recognition with central vision loss. Optom Vis Sci. 93 (5), 510-520 (2016).">Bernard, J. B., Chung, S. T. L. The role of external features in face recognition with central vision loss. Optom Vis Sci. 93 (5), 510-520 (2016).
  5. Quality of life in patients with age-related macular degeneration. Medicina (Kaunas). 48, 109-111 (2012).">Šiaudvytytė, L., Mitkutė, D., Balčiūnienė, J. Quality of life in patients with age-related macular degeneration. Medicina (Kaunas). 48, 109-111 (2012).
  6. Mental stress as consequence and cause of vision loss: the dawn of psychosomatic ophthalmology for preventive and personalized medicine. EPMA J. 9 (2), 133-160 (2018).">Sabel, B. A., Wang, J., Cárdenas-Morales, L., Faiq, M., Heim, C. Mental stress as consequence and cause of vision loss: the dawn of psychosomatic ophthalmology for preventive and personalized medicine. EPMA J. 9 (2), 133-160 (2018).
  7. Preferred retinal loci relationship to macular scotomas in a low-vision population. Ophthalmology. 104 (4), 632-638 (1997).">Fletcher, D. C., Schuchard, R. A. Preferred retinal loci relationship to macular scotomas in a low-vision population. Ophthalmology. 104 (4), 632-638 (1997).
  8. The oculomotor reference in humans with bilateral macular disease. Invest Ophthalmol Vis Sci. 31 (6), 1149-1161 (1990).">White, J. M., Bedell, H. E. The oculomotor reference in humans with bilateral macular disease. Invest Ophthalmol Vis Sci. 31 (6), 1149-1161 (1990).
  9. Foveating saccades. Vision Res. 30 (9), 1363-1366 (1990).">Whittaker, S. G., Cummings, R. W. Foveating saccades. Vision Res. 30 (9), 1363-1366 (1990).
  10. Reorganization of early visual cortex functional connectivity following selective peripheral and central visual loss. Sci Rep. 7, 43223(2017).">Sabbah, N., et al. Reorganization of early visual cortex functional connectivity following selective peripheral and central visual loss. Sci Rep. 7, 43223(2017).
  11. Efficacy of biofeedback rehabilitation based on visual evoked potentials analysis in patients with advanced age-related macular degeneration. Sci Rep. 10, 20886(2020).">Verdina, T., et al. Efficacy of biofeedback rehabilitation based on visual evoked potentials analysis in patients with advanced age-related macular degeneration. Sci Rep. 10, 20886(2020).
  12. Biofeedback rehabilitation of eccentric fixation in patients with Stargardt disease. Eur J Ophthalmol. 23 (5), 723-731 (2013).">Verdina, T., et al. Biofeedback rehabilitation of eccentric fixation in patients with Stargardt disease. Eur J Ophthalmol. 23 (5), 723-731 (2013).
  13. Location and stability of a newly established eccentric retinal locus suitable for reading, achieved through training of patients with a dense central scotoma. Optom Vis Sci. 75 (12), 873-878 (1998).">Nilsson, U. L., Frennesson, C., Nilsson, S. E. Location and stability of a newly established eccentric retinal locus suitable for reading, achieved through training of patients with a dense central scotoma. Optom Vis Sci. 75 (12), 873-878 (1998).
  14. Biofeedback fixation training method for improving eccentric vision in patients with loss of foveal function secondary to different maculopathies. Int Ophthalmol. 40 (2), 305-312 (2020).">Morales, M. U., et al. Biofeedback fixation training method for improving eccentric vision in patients with loss of foveal function secondary to different maculopathies. Int Ophthalmol. 40 (2), 305-312 (2020).
  15. Patients with AMD and a large absolute central scotoma can be trained successfully to use eccentric viewing, as demonstrated in a scanning laser ophthalmoscope. Vision Res. 43 (16), 1777-1787 (2003).">Nilsson, U. L., Frennesson, C., Nilsson, S. E. Patients with AMD and a large absolute central scotoma can be trained successfully to use eccentric viewing, as demonstrated in a scanning laser ophthalmoscope. Vision Res. 43 (16), 1777-1787 (2003).
  16. Reading training with threshold stimuli in people with central vision loss: a feasibility study. Optom Vis Sci. 91 (1), 86-96 (2014).">Tarita-Nistor, L., Brent, M. H., Steinbach, M. J., Markowitz, S. N., González, E. G. Reading training with threshold stimuli in people with central vision loss: a feasibility study. Optom Vis Sci. 91 (1), 86-96 (2014).
  17. Perceptual learning leads to long lasting visual improvement in patients with central vision loss. Restor Neurol Neurosci. 34 (5), 697-720 (2016).">Maniglia, M., et al. Perceptual learning leads to long lasting visual improvement in patients with central vision loss. Restor Neurol Neurosci. 34 (5), 697-720 (2016).
  18. Combining fixation and lateral masking training enhances perceptual learning effects in patients with macular degeneration. J Vis. 20 (10), 19(2020).">Maniglia, M., Soler, V., Trotter, Y. Combining fixation and lateral masking training enhances perceptual learning effects in patients with macular degeneration. J Vis. 20 (10), 19(2020).
  19. Improving reading speed for people with central vision loss through perceptual learning. Invest. Ophthalmol Vis Sci. 52 (2), 1164-1170 (2011).">Chung, S. T. L. Improving reading speed for people with central vision loss through perceptual learning. Invest. Ophthalmol Vis Sci. 52 (2), 1164-1170 (2011).
  20. Perceptual learning in patients with macular degeneration. Front Psychol. 5, 1189(2014).">Plank, T., et al. Perceptual learning in patients with macular degeneration. Front Psychol. 5, 1189(2014).
  21. A new perceptual training strategy to improve vision impaired by central vision loss. Vision Res. 174, 69-76 (2020).">Xie, X. Y., Liu, L., Yu, C. A new perceptual training strategy to improve vision impaired by central vision loss. Vision Res. 174, 69-76 (2020).
  22. Reading with simulated scotomas: attending to the right is better than attending to the left. Vision Res. 39 (5), 1039-1048 (1999).">Fine, E. M., Rubin, G. S. Reading with simulated scotomas: attending to the right is better than attending to the left. Vision Res. 39 (5), 1039-1048 (1999).
  23. Orientation of the preferred retinal locus (PRL) is maintained following changes in simulated scotoma size. J Vis. 20 (7), 25(2020).">Costela, F. M., Reeves, S. M., Woods, R. L. Orientation of the preferred retinal locus (PRL) is maintained following changes in simulated scotoma size. J Vis. 20 (7), 25(2020).
  24. Cortical reorganization of peripheral vision induced by simulated central vision loss. J. Neurosci. 39 (18), 3529-3536 (2019).">Chen, N., et al. Cortical reorganization of peripheral vision induced by simulated central vision loss. J. Neurosci. 39 (18), 3529-3536 (2019).
  25. The effect of simulated scotomas on visual search in normal subjects. Invest Ophthalmol Vis Sci. 29 (3), 470-475 (1988).">Bertera, J. H. The effect of simulated scotomas on visual search in normal subjects. Invest Ophthalmol Vis Sci. 29 (3), 470-475 (1988).
  26. Can positions in the visual field with high attentional capabilities be good candidates for a new preferred retinal locus. Vision Res. 140, 1-12 (2017).">Barraza-Bernal, M. J., et al. Can positions in the visual field with high attentional capabilities be good candidates for a new preferred retinal locus. Vision Res. 140, 1-12 (2017).
  27. Rapid and persistent adaptability of human oculomotor control in response to simulated central vision loss. Curr Biol. 23 (17), 1663-1669 (2013).">Kwon, M., Nandy, A. S., Tjan, B. S. Rapid and persistent adaptability of human oculomotor control in response to simulated central vision loss. Curr Biol. 23 (17), 1663-1669 (2013).
  28. Integrating oculomotor and perceptual training to induce a pseudofovea: A model system for studying central vision loss. J Vis. 16 (6), 10(2016).">Liu, R., Kwon, M. Integrating oculomotor and perceptual training to induce a pseudofovea: A model system for studying central vision loss. J Vis. 16 (6), 10(2016).
  29. We don't all look the same; detailed examination of peripheral looking strategies after simulated central vision loss. J Vis. 20 (13), 5(2020).">Maniglia, M., Jogin, R., Visscher, K. M., Seitz, A. R. We don't all look the same; detailed examination of peripheral looking strategies after simulated central vision loss. J Vis. 20 (13), 5(2020).
  30. Adaptation to a simulated central scotoma during visual search training. Vision Res. 96, 75-86 (2014).">Walsh, D. V., Liu, L. Adaptation to a simulated central scotoma during visual search training. Vision Res. 96, 75-86 (2014).
  31. Macular degeneration affects eye movement behavior during visual search. Front Psychol. 4, 579(2013).">Van der Stigchel, S., et al. Macular degeneration affects eye movement behavior during visual search. Front Psychol. 4, 579(2013).
  32. Perspective on vision science-informed interventions for central vision loss. Front Neurosci. 15, 734970(2021).">Maniglia, M., Visscher, K. M., Seitz, A. R. Perspective on vision science-informed interventions for central vision loss. Front Neurosci. 15, 734970(2021).
  33. Gaze-contingent simulation of retinopathy: some potential pitfalls and remedies. Vision Res. 51, 997-1012 (2011).">Aguilar, C., Castet, E. Gaze-contingent simulation of retinopathy: some potential pitfalls and remedies. Vision Res. 51, 997-1012 (2011).
  34. PsyBuilder: An Open-Source, Cross-Platform Graphical Experiment Builder for Psychtoolbox With Built-In Performance Optimization. Adv Meth Pract Psychol Sci. 5, 251524592110705(2022).">Lin, Z., Yang, Z., Feng, C., Zhang, Y. PsyBuilder: An Open-Source, Cross-Platform Graphical Experiment Builder for Psychtoolbox With Built-In Performance Optimization. Adv Meth Pract Psychol Sci. 5, 251524592110705(2022).
  35. The timing mega-study: comparing a range of experiment generators, both lab-based and online. PeerJ. 8, e9414(2020).">Bridges, D., Pitiot, A., MacAskill, M. R., Peirce, J. W. The timing mega-study: comparing a range of experiment generators, both lab-based and online. PeerJ. 8, e9414(2020).
  36. How monitor characteristics affect human perception in visual computer experiments: CRT vs. LCD monitors in millisecond precise timing research. Sci Rep. 10, 6962(2020).">Rohr, M., Wagner, A. How monitor characteristics affect human perception in visual computer experiments: CRT vs. LCD monitors in millisecond precise timing research. Sci Rep. 10, 6962(2020).
  37. Direct measurement of the system latency of gaze-contingent displays. Behav Res Methods. 46 (2), 439-447 (2014).">Saunders, D. R., Woods, R. L. Direct measurement of the system latency of gaze-contingent displays. Behav Res Methods. 46 (2), 439-447 (2014).
  38. Developing robust methods and tools for advancing perceptual learning research. , UC Riverside. https://escholarship.org/uc/item/7gk9r0q3 (2024).">Jayakumar, S. Developing robust methods and tools for advancing perceptual learning research. , UC Riverside. https://escholarship.org/uc/item/7gk9r0q3 (2024).
  39. What is the best fixation target? The effect of target shape on stability of fixational eye movements. Vision Res. 76, 31-42 (2013).">Thaler, L., Schütz, A. C., Goodale, M. A., Gegenfurtner, K. R. What is the best fixation target? The effect of target shape on stability of fixational eye movements. Vision Res. 76, 31-42 (2013).
  40. Construct validity in the Trail Making Test: What makes Part B harder. J Clin Exp Neuropsychol. 17 (4), 529-535 (1995).">Gaudino, E. A., Geisler, M. W., Squires, N. K. Construct validity in the Trail Making Test: What makes Part B harder. J Clin Exp Neuropsychol. 17 (4), 529-535 (1995).
  41. Fixation stability and reading speed in patients with newly developed macular disease. Ophthalmic Physiol Opt. 24 (4), 327-333 (2004).">Crossland, M. D., Culham, L. E., Rubin, G. S. Fixation stability and reading speed in patients with newly developed macular disease. Ophthalmic Physiol Opt. 24 (4), 327-333 (2004).
  42. A method to characterize compensatory oculomotor strategies following simulated central vision loss. J Vis. 20 (9), 15(2020).">Maniglia, M., Visscher, K. M., Seitz, A. R. A method to characterize compensatory oculomotor strategies following simulated central vision loss. J Vis. 20 (9), 15(2020).
  43. Oculomotor responses of the visual system to an artificial central scotoma may not represent genuine visuomotor adaptation. J Vis. 22 (10), 17(2022).">Agaoglu, M. N., Fung, W., Chung, S. T. L. Oculomotor responses of the visual system to an artificial central scotoma may not represent genuine visuomotor adaptation. J Vis. 22 (10), 17(2022).
  44. A computer and video display based system for training eccentric viewing in macular degeneration with an absolute central scotoma. Doc Ophthalmol. 91 (1), 9-16 (1995).">Frennesson, C., Jakobsson, P., Nilsson, U. L. A computer and video display based system for training eccentric viewing in macular degeneration with an absolute central scotoma. Doc Ophthalmol. 91 (1), 9-16 (1995).
  45. Patient awareness of binocular central scotoma in age-related macular degeneration. Optom Vis Sci. 89 (9), 1395-1398 (2012).">Fletcher, D. C., Schuchard, R. A., Renninger, L. W. Patient awareness of binocular central scotoma in age-related macular degeneration. Optom Vis Sci. 89 (9), 1395-1398 (2012).
  46. A nonvisual eye tracker calibration method for video-based tracking. J Vis. 18 (9), 13(2018).">Harrar, V., Le Trung, W., Malienko, A., Khan, A. Z. A nonvisual eye tracker calibration method for video-based tracking. J Vis. 18 (9), 13(2018).
  47. Visual rehabilitation via microperimetry in patients with geographic atrophy: a pilot study. Int J Retina Vitreous. 3, 21(2017).">Ramírez Estudillo, J. A., et al. Visual rehabilitation via microperimetry in patients with geographic atrophy: a pilot study. Int J Retina Vitreous. 3, 21(2017).

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Tags

Gaze Contingent DisplayCentral Vision LossMacular DegenerationPerceptual LearningEye TrackingSimulated ScotomaOculomotor PerformancePeripheral Vision TrainingVisual Processing TasksPreferred Retinal Locus

Related Articles