Methods to Test Visual Attention Online

Online data collection methods have particular appeal to behavioral scientists because they offer the promise of much larger and much more representative ...

University of Wisconsin-Madison

As video-game playing has become a ubiquitous activity in today's society, it is worth considering its potential consequences on perceptual and motor skills. It is well known that exposing an organism to an altered visual environment often results in modification of the visual system of the organism. The field of perceptual learning provides many examples of training-induced increases in performance. But perceptual learning, when it occurs, tends to be specific to the trained task; that is, generalization to new tasks is rarely found. Here we show, by contrast, that action-video-game playing is capable of altering a range of visual skills. Four experiments establish changes in different aspects of visual attention in habitual video-game players as compared with non-video-game players. In a fifth experiment, non-players trained on an action video game show marked improvement from their pre-training abilities, thereby establishing the role of playing in this effect.

Action video game modifies visual selective attention.

The authors investigated the effect of action gaming on the spatial distribution of attention. The authors used the flanker compatibility effect to separately assess center and peripheral attentional resources in gamers versus nongamers. Gamers exhibited an enhancement in attentional resources compared with nongamers, not only in the periphery but also in central vision. The authors then used a target localization task to unambiguously establish that gaming enhances the spatial distribution of visual attention over a wide field of view. Gamers were more accurate than nongamers at all eccentricities tested, and the advantage held even when a concurrent center task was added, ruling out a trade-off between central and peripheral attention. By establishing the causal role of gaming through training studies, the authors demonstrate that action gaming enhances visuospatial attention throughout the visual field.

Effect of action video games on the spatial distribution of visuospatial attention.

Previous studies have demonstrated that early deafness causes enhancements in peripheral visual attention. Here, we ask if this cross-modal plasticity of visual attention is accompanied by an increase in the number of objects that can be grasped at once. In a first experiment using an enumeration task, Deaf adult native signers and hearing non-signers performed comparably, suggesting that deafness does not enhance the number of objects one can attend to simultaneously. In a second experiment using the Multiple Object Tracking task, Deaf adult native signers and hearing non-signers also performed comparably when required to monitor several, distinct, moving targets among moving distractors. The results of these experiments suggest that deafness does not significantly alter the ability to allocate attention to several objects at once. Thus, early deafness does not enhance all facets of visual attention, but rather its effects are quite specific.

Deafness and visual enumeration: not all aspects of attention are modified by deafness.

In many everyday situations, speed is of the essence. However, fast decisions typically mean more mistakes. To this day, it remains unknown whether reaction times can be reduced with appropriate training, within one individual, across a range of tasks, and without compromising accuracy. Here we review evidence that the very act of playing action video games significantly reduces reaction times without sacrificing accuracy. Critically, this increase in speed is observed across various tasks beyond game situations. Video gaming may therefore provide an efficient training regimen to induce a general speeding of perceptual reaction times without decreases in accuracy of performance.

Increasing Speed of Processing With Action Video Games.

Children encounter technology constantly at home and in school. Television, DVDs, video games, the Internet, and smart phones all play a formative role in children's development. The term "technology" subsumes a large variety of somewhat independent items, and it is no surprise that current research indicates causes for both optimism and concern depending upon the content of the technology, the context in which the technology immerses the user, and the user's developmental stage. Furthermore, because the field is still in its infancy, results can be surprising: video games designed to be reasonably mindless result in widespread enhancements of various abilities, acting, we will argue, as exemplary learning tools. Counterintuitive outcomes like these, besides being practically relevant, challenge and eventually lead to refinement of theories concerning fundamental principles of brain plasticity and learning.

Children, wired: for better and for worse.

Action video game play benefits performance in an array of sensory, perceptual, and attentional tasks that go well beyond the specifics of game play [1-9]. That a training regimen may induce improvements in so many different skills is notable because the majority of studies on training-induced learning report improvements on the trained task but limited transfer to other, even closely related, tasks ([10], but see also [11-13]). Here we ask whether improved probabilistic inference may explain such broad transfer. By using a visual perceptual decision making task [14, 15], the present study shows for the first time that action video game experience does indeed improve probabilistic inference. A neural model of this task [16] establishes how changing a single parameter, namely the strength of the connections between the neural layer providing the momentary evidence and the layer integrating the evidence over time, captures improvements in action-gamers behavior. These results were established in a visual, but also in a novel auditory, task, indicating generalization across modalities. Thus, improved probabilistic inference provides a general mechanism for why action video game playing enhances performance in a wide variety of tasks. In addition, this mechanism may serve as a signature of training regimens that are likely to produce transfer of learning.

Improved probabilistic inference as a general learning mechanism with action video games.

Many previous studies have shown that the speed of processing in attentionally demanding tasks seems enhanced following habitual action videogame play. However, using one of the diagnostic tasks for efficiency of attentional processing, a visual search task, Castel and collaborators (Castel, Pratt, & Drummond, Acta Psychologica 119:217-230, 2005) reported no difference in visual search rates, instead proposing that action gaming may change response execution time rather than the efficiency of visual selective attention per se. Here we used two hard visual search tasks, one measuring reaction time and the other accuracy, to test whether visual search rate may be changed by action videogame play. We found greater search rates in the gamer group than in the nongamer controls, consistent with increased efficiency in visual selective attention. We then asked how general the change in attentional throughput noted so far in gamers might be by testing whether exogenous attentional cues would lead to a disproportional enhancement in throughput in gamers as compared to nongamers. Interestingly, exogenous cues were found to enhance throughput equivalently between gamers and nongamers, suggesting that not all mechanisms known to enhance throughput are similarly enhanced in action videogamers.

Changes in search rate but not in the dynamics of exogenous attention in action videogame players.

The popular press is replete with stories about the effects of video and computer games on the brain. Sensationalist headlines claiming that video games 'damage the brain' or 'boost brain power' do not do justice to the complexities and limitations of the studies involved, and create a confusing overall picture about the effects of gaming on the brain. Here, six experts in the field shed light on our current understanding of the positive and negative ways in which playing video games can affect cognition and behaviour, and explain how this knowledge can be harnessed for educational and rehabilitation purposes. As research in this area is still in its early days, the contributors of this Viewpoint also discuss several issues and challenges that should be addressed to move the field forward.

Brains on video games.

There is now a substantial body of work demonstrating that action video game experience results in enhancements in a wide variety of perceptual skills. More recently, several groups have also demonstrated improvements in abilities that are more cognitive in nature, in particular, the ability to efficiently switch between tasks. In a series of four experiments, we add to this body of work, demonstrating that the action video game player advantage is not exclusively due to an ability to map manual responses onto arbitrary buttons, but rather generalizes to vocal responses, is not restricted to tasks that are perceptual in nature (e.g. respond to a physical dimension of the stimulus such as its color), but generalizes to more cognitive tasks (e.g. is a number odd or even), and is present whether the switch requires a goal-switch or only a motor switch. Finally, a training study establishes that the relationship between the reduction in switch cost and action game playing is causal.

The effect of action video game experience on task-switching.

The ability of the human brain to learn is exceptional. Yet, learning is typically quite specific to the exact task used during training, a limiting factor for practical applications such as rehabilitation, workforce training, or education. The possibility of identifying training regimens that have a broad enough impact to transfer to a variety of tasks is thus highly appealing. This work reviews how complex training environments such as action video game play may actually foster brain plasticity and learning. This enhanced learning capacity, termed learning to learn, is considered in light of its computational requirements and putative neural mechanisms.

Brain plasticity through the life span: learning to learn and action video games.

The past two decades have seen a tremendous surge in scientific interest in the extent to which certain types of training-be it aerobic, athletic, musical, video game, or brain trainer-can result in general enhancements in cognitive function. While there are certainly active debates regarding the results in these domains, what is perhaps more pressing is the fact that key aspects of methodology remain unsettled. Here we discuss a few of these areas including expectation effects, test-retest effects, the size of the cognitive test battery, the selection of control groups, group assignment methods, difficulties in comparing results across studies, and in interpreting null results. Specifically, our goal is to highlight points of contention as well as areas where the most commonly utilized methods could be improved upon. Furthermore, because each of the sub-areas above (aerobic training through brain training) share strong similarities in goal, theoretical framework, and experimental approach, we seek to discuss these issues from a general perspective that considers each as members of the same broad "training" domain.

On methodological standards in training and transfer experiments.

The goal of training is to produce learning for a range of activities that are typically more general than the training task itself. Despite a century of research, predicting the scope of learning from the content of training has proven extremely difficult, with the same task producing narrowly focused learning strategies in some cases and broadly scoped learning strategies in others. Here we test the hypothesis that human subjects will prefer a decision strategy that maximizes performance and reduces uncertainty given the demands of the training task and that the strategy chosen will then predict the extent to which learning is transferable. To test this hypothesis, we trained subjects on a moving dot extrapolation task that makes distinct predictions for two types of learning strategy: a narrow model-free strategy that learns an input-output mapping for training stimuli, and a general model-based strategy that utilizes humans' default predictive model for a class of trajectories. When the number of distinct training trajectories is low, we predict better performance for the mapping strategy, but as the number increases, a predictive model is increasingly favored. Consonant with predictions, subject extrapolations for test trajectories were consistent with using a mapping strategy when trained on a small number of training trajectories and a predictive model when trained on a larger number. The general framework developed here can thus be useful both in interpreting previous patterns of task-specific versus task-general learning, as well as in building future training paradigms with certain desired outcomes.

Task-specific response strategy selection on the basis of recent training experience.

Action video games have been shown to enhance behavioral performance on a wide variety of perceptual tasks, from those that require effective allocation of attentional resources across the visual scene, to those that demand the successful identification of fleetingly presented stimuli. Importantly, these effects have not only been shown in expert action video game players, but a causative link has been established between action video game play and enhanced processing through training studies. Although an account based solely on attention fails to capture the variety of enhancements observed after action game playing, a number of models of perceptual learning are consistent with the observed results, with behavioral modeling favoring the hypothesis that avid video game players are better able to form templates for, or extract the relevant statistics of, the task at hand. This may suggest that the neural site of learning is in areas where information is integrated and actions are selected; yet changes in low-level sensory areas cannot be ruled out.

Perceptual learning during action video game playing.

The field of perceptual learning has identified changes in perceptual templates as a powerful mechanism mediating the learning of statistical regularities in our environment. By measuring threshold-vs.-contrast curves using an orientation identification task under varying levels of external noise, the perceptual template model (PTM) allows one to disentangle various sources of signal-to-noise changes that can alter performance. We use the PTM approach to elucidate the mechanism that underlies the wide range of improvements noted after action video game play. We show that action video game players make use of improved perceptual templates compared with nonvideo game players, and we confirm a causal role for action video game play in inducing such improvements through a 50-h training study. Then, by adapting a recent neural model to this task, we demonstrate how such improved perceptual templates can arise from reweighting the connectivity between visual areas. Finally, we establish that action gamers do not enter the perceptual task with improved perceptual templates. Instead, although performance in action gamers is initially indistinguishable from that of nongamers, action gamers more rapidly learn the proper template as they experience the task. Taken together, our results establish for the first time to our knowledge the development of enhanced perceptual templates following action game play. Because such an improvement can facilitate the inference of the proper generative model for the task at hand, unlike perceptual learning that is quite specific, it thus elucidates a general learning mechanism that can account for the various behavioral benefits noted after action game play.

Article	Year
Action video game modifies visual selective attention. Nature\| PubMed ID: 12774121	2003
Effect of action video games on the spatial distribution of visuospatial attention. Journal of experimental psychology. Human perception and performance\| PubMed ID: 17154785	2006
Deafness and visual enumeration: not all aspects of attention are modified by deafness. Brain research\| PubMed ID: 17467671	2007
Increasing Speed of Processing With Action Video Games. Current directions in psychological science\| PubMed ID: 20485453	2009
Children, wired: for better and for worse. Neuron\| PubMed ID: 20826302	2010
Improved probabilistic inference as a general learning mechanism with action video games. Current biology : CB\| PubMed ID: 20833324	2010
Changes in search rate but not in the dynamics of exogenous attention in action videogame players. Attention, perception & psychophysics\| PubMed ID: 21901575	2011
Brains on video games. Nature reviews. Neuroscience\| PubMed ID: 22095065	2011
The effect of action video game experience on task-switching. Computers in human behavior\| PubMed ID: 22393270	2012
Brain plasticity through the life span: learning to learn and action video games. Annual review of neuroscience\| PubMed ID: 22715883	2012
On methodological standards in training and transfer experiments. Psychological research\| PubMed ID: 24346424	2014
Task-specific response strategy selection on the basis of recent training experience. PLoS computational biology\| PubMed ID: 24391490	2014
Perceptual learning during action video game playing. Topics in cognitive science\| PubMed ID: 25163784	2010
Action video game play facilitates the development of better perceptual templates. Proceedings of the National Academy of Sciences of the United States of America\| PubMed ID: 25385590	2014

C. Shawn Green

Biography

JoVE Journal Publications

Other Publications