Summary

Сочетание компьютерных игр основе поведенческих экспериментов с высокой плотностью ЭЭГ и инфракрасного слежения Gaze

Published: December 16, 2010
doi:

Summary

Процедуры для записи с высокой плотностью ЭЭГ и смотреть данные во время компьютерной игры основе когнитивных задач описаны. Использование видеоигр представить познавательных задач повышает экологическую валидность без ущерба для экспериментального контроля.

Abstract

Experimental paradigms are valuable insofar as the timing and other parameters of their stimuli are well specified and controlled, and insofar as they yield data relevant to the cognitive processing that occurs under ecologically valid conditions. These two goals often are at odds, since well controlled stimuli often are too repetitive to sustain subjects’ motivation. Studies employing electroencephalography (EEG) are often especially sensitive to this dilemma between ecological validity and experimental control: attaining sufficient signal-to-noise in physiological averages demands large numbers of repeated trials within lengthy recording sessions, limiting the subject pool to individuals with the ability and patience to perform a set task over and over again. This constraint severely limits researchers’ ability to investigate younger populations as well as clinical populations associated with heightened anxiety or attentional abnormalities. Even adult, non-clinical subjects may not be able to achieve their typical levels of performance or cognitive engagement: an unmotivated subject for whom an experimental task is little more than a chore is not the same, behaviourally, cognitively, or neurally, as a subject who is intrinsically motivated and engaged with the task. A growing body of literature demonstrates that embedding experiments within video games may provide a way between the horns of this dilemma between experimental control and ecological validity. The narrative of a game provides a more realistic context in which tasks occur, enhancing their ecological validity (Chaytor & Schmitter-Edgecombe, 2003). Moreover, this context provides motivation to complete tasks. In our game, subjects perform various missions to collect resources, fend off pirates, intercept communications or facilitate diplomatic relations. In so doing, they also perform an array of cognitive tasks, including a Posner attention-shifting paradigm (Posner, 1980), a go/no-go test of motor inhibition, a psychophysical motion coherence threshold task, the Embedded Figures Test (Witkin, 1950, 1954) and a theory-of-mind (Wimmer & Perner, 1983) task. The game software automatically registers game stimuli and subjects’ actions and responses in a log file, and sends event codes to synchronise with physiological data recorders. Thus the game can be combined with physiological measures such as EEG or fMRI, and with moment-to-moment tracking of gaze. Gaze tracking can verify subjects’ compliance with behavioural tasks (e.g. fixation) and overt attention to experimental stimuli, and also physiological arousal as reflected in pupil dilation (Bradley et al., 2008). At great enough sampling frequencies, gaze tracking may also help assess covert attention as reflected in microsaccades – eye movements that are too small to foveate a new object, but are as rapid in onset and have the same relationship between angular distance and peak velocity as do saccades that traverse greater distances. The distribution of directions of microsaccades correlates with the (otherwise) covert direction of attention (Hafed & Clark, 2002).

Protocol

1. Дизайн Развлекательные и научно Информационные Игры Применение итерационных игрового дизайна процесса, в котором проблемы научную ценность и пригодность для игры информировать друг друга. Как экспериментатор, у вас есть идеи относительно того, стимулы и поведенческ?…

Discussion

Возможно, самым важным препятствием для комплексных исследований является практическое ограничение на количество времени, которое одно испытуемого (особенно один из клинических населения) можно разумно ожидать, чтобы выполнить, прежде чем стать усталость. К сожалению, часто более ко?…

Disclosures

The authors have nothing to disclose.

Acknowledgements

Этот проект финансируется Аутизм Говорит Pilot исследований, грант № 2597 и от Национального научного фонда США факультет Рано премии развития карьеры # BCS-0846892.

Materials

Material Name Type Company Catalogue Number Comment
128-channel BioSemi ActiveTwo measurement system   BioSemi   http://www.biosemi.com
32 channel A-set + CMS/DRL   BioSemi P32-ABC-ACMS  
32 channel B-set   BioSemi P32-ABC-B  
32 channel C-set   BioSemi P32-ABC-C  
32 channel D-set   BioSemi P32-ABC-D  
EX1-EX8 electrodes   BioSemi 8 x TP PIN  
128-channel cap   BioSemi CAP M 128  
EyeLink 1000 infrared gaze tracker   SR Research    
EyeLink 1000 Remote Camera Upgrade   SR Research n/a Allows for target sticker tracking
SignaGel electrode gel   Parker Labs n/a  
0.05% KCl electrolytic (NaCl) gel   n/a n/a Purchased from compounding pharmacy
Intensity Pro   Blackmagic Design    

References

  1. Bell, A. J., Sejnowski, T. J. An information maximisation approach to blind separation and blind deconvolution. Neural Computation. 7, 1129-1159 (1995).
  2. Belmonte, M. K. Shifts of visual spatial attention modulate a steady-state visual evoked potential. Cognitive Brain Research. 6, 295-307 (1998).
  3. Belmonte, M. K. Abnormal attention in autism shown by steady-state visual evoked potentials. Autism. 4, 269-285 (2000).
  4. Benton, A. L., Sivan, A. B., Hamsher, K., Varney, N. R., Spreen, O. . Contributions to Neuropsychological Assessment. , (1994).
  5. Berka, C., Levendowski, D. J., Cvetinovic, M. M., Petrovic, M. M., Davis, G., Lumicao, M. N., Zivkovic, V. T. Real-time analyses of EEG indexes of alertness, cognition and memory acquired with a wireless EEG headset. International Journal of Human-Computer Interaction. 17, 151-170 (2004).
  6. Bradley, M. M., Miccoli, L., Escrig, M. A., Lang, P. J. The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology. 45, 602-607 (2008).
  7. Brookings, J. B., Wilson, G. F., Swain, C. R. Psychophysiological responses to changes in work-load during simulated air traffic control. Biological Psychology. 42, 361-377 (1996).
  8. Castel, A. D., Pratt, J., Drummond, E. The effects of action video game experience on the time course of inhibition of return and the efficiency of visual search. Acta Psychologica. 119, 217-230 (2005).
  9. Chaytor, N., Schmitter-Edgecombe, M. The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills. Neuropsychology Review. 13, 181-197 (2003).
  10. Dalton, K. M., Nacewicz, B. M., Johnstone, T., Schaefer, H. S., Gernsbacher, M. A., Goldsmith, H. H., Alexander, A. L., Davidson, R. J. Gaze fixation and the neural circuitry of face processing in autism. Nature Neuroscience. 8, 519-526 (2005).
  11. Delorme, A., Makeig, S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics. Journal of Neuroscience Methods. 134, 9-21 (2004).
  12. Ebisawa, Y. Improved video-based eye-gaze detection method. IEEE Transactions on Instrumentation and Measurement. 47, 948-955 (1998).
  13. Feng, J., Spence, I., Pratt, J. Playing an action video game reduces gender differences in spatial cognition. Psychological Science. 18, 850-855 (2007).
  14. Ferree, T. C., Luu, P., Russell, G. S., Tucker, D. M. Scalp electrode impedance, infection risk, and EEG data quality. Clinical Neurophysiology. 112, 536-544 (2001).
  15. Golan, O., Baron-Cohen, S. Systemizing empathy: teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive media. Development and Psychopathology. 18, 591-617 (2006).
  16. Graner Ray, S., S, Gender inclusive game design: Expanding the market. , (2004).
  17. Green, C. S., Bavelier, D. Action video game modifies visual selective attention. Nature. 423, 534-537 (2003).
  18. Green, C. S., Bavelier, D. Enumeration versus multiple object tracking: the case of action video game players. Cognition. 101, 217-245 .
  19. Green, C. S., Bavelier, D. Effect of action video games on the spatial distribution of visuospatial attention. Journal of Experimental Psychology Human Perception and Performance. 32, 1465-1478 (2006).
  20. Green, C. S., Bavelier, D. Action-video-game experience alters the spatial resolution of vision. Psychological Science. 18, 88-94 (2007).
  21. Hafed, Z. M., Clark, J. J. Microsaccades as an overt measure of covert attention shifts. Vision Research. 42, 2533-2545 (2002).
  22. Lieberman, H. R., Pentland, A. P. Microcomputer-based estimation of psychophysical thresholds: the best PEST. Behavior Research Methods and Instrumentation. 14, 21-25 (1982).
  23. Luck, S. J. . An Introduction to the Event-Related Potential Technique. , (2005).
  24. Lykken, D. T., Venables, P. H. Direct measurement of skin conductance: a proposal for standardization. Psychophysiology. 8, 656-672 (1971).
  25. Makeig, S., Delorme, A., Westerfield, M., Jung, T., Townsend, J., Courchesne, E., Sejnowski, T. J. Electroencephalographic brain dynamics following manually responded visual targets. PLoS Biology. 2, e176-e176 (2004).
  26. Makeig, S., Jung, T., Bell, A. J., Ghahremani, D., Sejnowski, T. J. Blind separation of auditory event-related brain responses into independent components. Proceedings of the National Academy of Sciences of the United States of America. 94, 10979-10984 (1997).
  27. Makeig, S., Westerfield, M., Jung, T. P., Enghoff, S., Townsend, J., Courchesne, E., Sejnowski, T. J. Dynamic brain sources of visual evoked responses. Science. 295, 690-694 (2002).
  28. Morgan, S. T., Hansen, J. C., Hillyard, S. A. Selective attention to stimulus location modulates the steady-state visual evoked potential. Proceedings of the National Academy of Sciences of the United States of America. 93, 4770-4774 (1996).
  29. Pentland, A. P. Maximum likelihood estimation: the best PEST. Perception and Psychophysics. 28, 377-379 (1980).
  30. Plaisted, K., Swettenham, J., Rees, L. Children with autism show local precedence in a divided attention task and global precedence in a selective attention task. Journal of Child Psychology and Psychiatry. 40, 733-742 (1999).
  31. Posner, M. I. Orienting of attention. Quarterly Journal of Experimental Psychology. 32, 3-25 (1980).
  32. Smith, M. E., McEvoy, L. K., Gevins, A. Neurophysiological indices of strategy development and skill acquisition. Cognitive Brain Research. 7, 389-404 (1999).
  33. St John, M., Kobus, D. A., Morrison, J. G. A multi-tasking environment for manipulating and measuring neural correlates of cognitive workload. , (2002).
  34. St John, M., Kobus, D. A., Morrison, J. G., Schmorrow, D. Overview of the DARPA augmented cognition technical integration experiment. International Journal of Human-Computer Interac-tion. 17, 131-149 (2004).
  35. Thorell, L. B., Lindqvist, S., Nutley, S. B., Bohlin, G., Klingberg, T. Training and transfer effects of executive functions in preschool children. Developmental Science. 12, 106-113 (2009).
  36. Valla, J. M., Ganzel, B. L., Yoder, K. J., Chen, G. M., Lyman, L. T., Sidari, A. P., Keller, A. E., Maendel, J. W., Perlman, J. E., Wong, S. K. L., Belmonte, M. K. More than maths and mindread-ing: sex differences in empathising/systemising covariance. Autism Research. , (2010).
  37. Witkin, H. A. Individual differences in ease of perception of embedded figures. Journal of Personality. 19, 1-15 (1950).
  38. Witkin, H. A., Lewis, H. B., Hertzman, M., Machover, K., Meissner, P. B., Wapner, S. . Personality through Perception. , (1954).
  39. Wimmer, H., Perner, J. Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition. 13, 103-128 (1983).
  40. von Ahn, L. Games with a purpose. Computer. 39, 92-94 (2006).

Play Video

Cite This Article
Yoder, K. J., Belmonte, M. K. Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking. J. Vis. Exp. (46), e2320, doi:10.3791/2320 (2010).

View Video