Mori's Uncanny Valley Hypothesis1,2 proposes that the perception of humanlike characters such as robots and, by extension, avatars (computer-generated characters) can evoke negative or positive affect (valence) depending on the object's degree of visual and behavioral realism along a dimension of human likeness (DHL) (Figure 1). But studies of affective valence of subjective responses to variously realistic non-human characters have produced inconsistent findings 3, 4, 5, 6. One of a number of reasons for this is that human likeness is not perceived as the hypothesis assumes. While the DHL can be defined following Mori's description as a smooth linear change in the degree of physical humanlike similarity, subjective perception of objects along the DHL can be understood in terms of the psychological effects of categorical perception (CP) 7. Further behavioral and neuroimaging investigations of category processing and CP along the DHL and of the potential influence of the dimension's underlying category structure on affective experience are needed. This protocol therefore focuses on the DHL and allows examination of CP. Based on the protocol presented in the video as an example, issues surrounding the methodology in the protocol and the use in "uncanny" research of stimuli drawn from morph continua to represent the DHL are discussed in the article that accompanies the video. The use of neuroimaging and morph stimuli to represent the DHL in order to disentangle brain regions neurally responsive to physical human-like similarity from those responsive to category change and category processing is briefly illustrated.
23 Related JoVE Articles!
Measuring Attentional Biases for Threat in Children and Adults
Institutions: Rutgers University.
Investigators have long been interested in the human propensity for the rapid detection of threatening stimuli. However, until recently, research in this domain has focused almost exclusively on adult participants, completely ignoring the topic of threat detection over the course of development. One of the biggest reasons for the lack of developmental work in this area is likely the absence of a reliable paradigm that can measure perceptual biases for threat in children. To address this issue, we recently designed a modified visual search paradigm similar to the standard adult paradigm that is appropriate for studying threat detection in preschool-aged participants. Here we describe this new procedure. In the general paradigm, we present participants with matrices of color photographs, and ask them to find and touch a target on the screen. Latency to touch the target is recorded. Using a touch-screen monitor makes the procedure simple and easy, allowing us to collect data in participants ranging from 3 years of age to adults. Thus far, the paradigm has consistently shown that both adults and children detect threatening stimuli (e.g.,
snakes, spiders, angry/fearful faces) more quickly than neutral stimuli (e.g.,
flowers, mushrooms, happy/neutral faces). Altogether, this procedure provides an important new tool for researchers interested in studying the development of attentional biases for threat.
Behavior, Issue 92, Detection, threat, attention, attentional bias, anxiety, visual search
Correlating Behavioral Responses to fMRI Signals from Human Prefrontal Cortex: Examining Cognitive Processes Using Task Analysis
Institutions: Centre for Vision Research, York University, Centre for Vision Research, York University.
The aim of this methods paper is to describe how to implement a neuroimaging technique to examine complementary brain processes engaged by two similar tasks. Participants' behavior during task performance in an fMRI scanner can then be correlated to the brain activity using the blood-oxygen-level-dependent signal. We measure behavior to be able to sort correct trials, where the subject performed the task correctly and then be able to examine the brain signals related to correct performance. Conversely, if subjects do not perform the task correctly, and these trials are included in the same analysis with the correct trials we would introduce trials that were not only for correct performance. Thus, in many cases these errors can be used themselves to then correlate brain activity to them. We describe two complementary tasks that are used in our lab to examine the brain during suppression of an automatic responses: the stroop1
and anti-saccade tasks. The emotional stroop paradigm instructs participants to either report the superimposed emotional 'word' across the affective faces or the facial 'expressions' of the face stimuli1,2
. When the word and the facial expression refer to different emotions, a conflict between what must be said and what is automatically read occurs. The participant has to resolve the conflict between two simultaneously competing processes of word reading and facial expression. Our urge to read out a word leads to strong 'stimulus-response (SR)' associations; hence inhibiting these strong SR's is difficult and participants are prone to making errors. Overcoming this conflict and directing attention away from the face or the word requires the subject to inhibit bottom up processes which typically directs attention to the more salient stimulus. Similarly, in the anti-saccade task3,4,5,6
, where an instruction cue is used to direct only attention to a peripheral stimulus location but then the eye movement is made to the mirror opposite position. Yet again we measure behavior by recording the eye movements of participants which allows for the sorting of the behavioral responses into correct and error trials7
which then can be correlated to brain activity. Neuroimaging now allows researchers to measure different behaviors of correct and error trials that are indicative of different cognitive processes and pinpoint the different neural networks involved.
Neuroscience, Issue 64, fMRI, eyetracking, BOLD, attention, inhibition, Magnetic Resonance Imaging, MRI
P50 Sensory Gating in Infants
Institutions: University of Colorado School of Medicine, Colorado State University.
Attentional deficits are common in a variety of neuropsychiatric disorders including attention deficit-hyperactivity disorder, autism, bipolar mood disorder, and schizophrenia. There has been increasing interest in the neurodevelopmental components of these attentional deficits; neurodevelopmental meaning that while the deficits become clinically prominent in childhood or adulthood, the deficits are the results of problems in brain development that begin in infancy or even prenatally. Despite this interest, there are few methods for assessing attention very early in infancy. This report focuses on one method, infant auditory P50 sensory gating.
Attention has several components. One of the earliest components of attention, termed sensory gating, allows the brain to tune out repetitive, noninformative sensory information. Auditory P50 sensory gating refers to one task designed to measure sensory gating using changes in EEG. When identical auditory stimuli are presented 500 ms apart, the evoked response (change in the EEG associated with the processing of the click) to the second stimulus is generally reduced relative to the response to the first stimulus (i.e.
the response is "gated"). When response to the second stimulus is not reduced, this is considered a poor sensory gating, is reflective of impaired cerebral inhibition, and is correlated with attentional deficits.
Because the auditory P50 sensory gating task is passive, it is of potential utility in the study of young infants and may provide a window into the developmental time course of attentional deficits in a variety of neuropsychiatric disorders. The goal of this presentation is to describe the methodology for assessing infant auditory P50 sensory gating, a methodology adapted from those used in studies of adult populations.
Behavior, Issue 82, Child Development, Psychophysiology, Attention Deficit and Disruptive Behavior Disorders, Evoked Potentials, Auditory, auditory evoked potential, sensory gating, infant, attention, electrophysiology, infants, sensory gating, endophenotype, attention, P50
Exploring Cognitive Functions in Babies, Children & Adults with Near Infrared Spectroscopy
Institutions: University of Michigan, Ann Arbor, University of Toronto Scarborough.
An explosion of functional Near Infrared Spectroscopy (fNIRS) studies investigating cortical activation in relation to higher cognitive processes, such as language1,2,3,4,5,6,7,8,9,10
, and attention12
is underway worldwide involving adults, children and infants 3,4,13,14,15,16,17,18,19
with typical and atypical cognition20,21,22
. The contemporary challenge of using fNIRS for cognitive neuroscience is to achieve systematic analyses of data such that they are universally interpretable23,24,25,26
, and thus may advance important scientific questions about the functional organization and neural systems underlying human higher cognition.
Existing neuroimaging technologies have either less robust temporal or spatial resolution. Event Related Potentials and Magneto Encephalography (ERP and MEG) have excellent temporal resolution, whereas Positron Emission Tomography and functional Magnetic Resonance Imaging (PET and fMRI) have better spatial resolution. Using non-ionizing wavelengths of light in the near-infrared range (700-1000 nm), where oxy-hemoglobin is preferentially absorbed by 680 nm and deoxy-hemoglobin is preferentially absorbed by 830 nm (e.g., indeed, the very wavelengths hardwired into the fNIRS Hitachi ETG-400 system illustrated here), fNIRS is well suited for studies of higher cognition because it has both good temporal resolution (~5s) without the use of radiation and good spatial resolution (~4 cm depth), and does not require participants to be in an enclosed structure27,28
. Participants cortical activity can be assessed while comfortably seated in an ordinary chair (adults, children) or even seated in mom s lap (infants). Notably, NIRS is uniquely portable (the size of a desktop computer), virtually silent, and can tolerate a participants subtle movement. This is particularly outstanding for the neural study of human language, which necessarily has as one of its key components the movement of the mouth in speech production or the hands in sign language.
The way in which the hemodynamic response is localized is by an array of laser emitters and detectors. Emitters emit a known intensity of non-ionizing light while detectors detect the amount reflected back from the cortical surface. The closer together the optodes, the greater the spatial resolution, whereas the further apart the optodes, the greater depth of penetration. For the fNIRS Hitachi ETG-4000 system optimal penetration / resolution the optode array is set to 2cm.
Our goal is to demonstrate our method of acquiring and analyzing fNIRS data to help standardize the field and enable different fNIRS labs worldwide to have a common background.
Neuroscience, Issue 29, infant, child, Near Infrared Spectroscopy, fNIRS, optical tomography, cognitive neuroscience, psychology, brain, developmental cognitive neuroscience, analysis
Measuring Oral Fatty Acid Thresholds, Fat Perception, Fatty Food Liking, and Papillae Density in Humans
Institutions: Deakin University.
Emerging evidence from a number of laboratories indicates that humans have the ability to identify fatty acids in the oral cavity, presumably via fatty acid receptors housed on taste cells. Previous research has shown that an individual's oral sensitivity to fatty acid, specifically oleic acid (C18:1) is associated with body mass index (BMI), dietary fat consumption, and the ability to identify fat in foods. We have developed a reliable and reproducible method to assess oral chemoreception of fatty acids, using a milk and C18:1 emulsion, together with an ascending forced choice triangle procedure. In parallel, a food matrix has been developed to assess an individual's ability to perceive fat, in addition to a simple method to assess fatty food liking. As an added measure tongue photography is used to assess papillae density, with higher density often being associated with increased taste sensitivity.
Neuroscience, Issue 88, taste, overweight and obesity, dietary fat, fatty acid, diet, fatty food liking, detection threshold
How to Create and Use Binocular Rivalry
Institutions: New York University, New York University, Princeton University, Princeton University.
Each of our eyes normally sees a slightly different image of the world around us. The brain can combine these two images into a single coherent representation. However, when the eyes are presented with images that are sufficiently different from each other, an interesting thing happens: Rather than fusing the two images into a combined conscious percept, what transpires is a pattern of perceptual alternations where one image dominates awareness while the other is suppressed; dominance alternates between the two images, typically every few seconds. This perceptual phenomenon is known as binocular rivalry. Binocular rivalry is considered useful for studying perceptual selection and awareness in both human and animal models, because unchanging visual input to each eye leads to alternations in visual awareness and perception. To create a binocular rivalry stimulus, all that is necessary is to present each eye with a different image at the same perceived location. There are several ways of doing this, but newcomers to the field are often unsure which method would best suit their specific needs. The purpose of this article is to describe a number of inexpensive and straightforward ways to create and use binocular rivalry. We detail methods that do not require expensive specialized equipment and describe each method's advantages and disadvantages. The methods described include the use of red-blue goggles, mirror stereoscopes and prism goggles.
Neuroscience, Issue 45, Binocular rivalry, continuous flash suppression, vision, visual awareness, perceptual competition, unconscious processing, neuroimaging
Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior
Institutions: Rutgers University, Rutgers University, Rutgers University, Rutgers University, Rutgers University.
Kinesthetic awareness is important to successfully navigate the environment. When we interact with our daily surroundings, some aspects of movement are deliberately planned, while others spontaneously occur below conscious awareness. The deliberate component of this dichotomy has been studied extensively in several contexts, while the spontaneous component remains largely under-explored. Moreover, how perceptual processes modulate these movement classes is still unclear. In particular, a currently debated issue is whether the visuomotor system is governed by the spatial percept produced by a visual illusion or whether it is not affected by the illusion and is governed instead by the veridical percept. Bistable percepts such as 3D depth inversion illusions (DIIs) provide an excellent context to study such interactions and balance, particularly when used in combination with reach-to-grasp movements. In this study, a methodology is developed that uses a DII to clarify the role of top-down processes on motor action, particularly exploring how reaches toward a target on a DII are affected in both deliberate and spontaneous movement domains.
Behavior, Issue 86, vision for action, vision for perception, motor control, reach, grasp, visuomotor, ventral stream, dorsal stream, illusion, space perception, depth inversion
Preterm EEG: A Multimodal Neurophysiological Protocol
Institutions: University of Helsinki , University of Helsinki , University of Helsinki , University of Helsinki .
Since its introduction in early 1950s, electroencephalography (EEG) has been widely used in the neonatal intensive care units (NICU) for assessment and monitoring of brain function in preterm and term babies. Most common indications are the diagnosis of epileptic seizures, assessment of brain maturity, and recovery from hypoxic-ischemic events. EEG recording techniques and the understanding of neonatal EEG signals have dramatically improved, but these advances have been slow to penetrate through the clinical traditions. The aim of this presentation is to bring theory and practice of advanced EEG recording available for neonatal units.
In the theoretical part, we will present animations to illustrate how a preterm brain gives rise to spontaneous and evoked EEG activities, both of which are unique to this developmental phase, as well as crucial for a proper brain maturation. Recent animal work has shown that the structural brain development is clearly reflected in early EEG activity. Most important structures in this regard are the growing long range connections and the transient cortical structure, subplate. Sensory stimuli in a preterm baby will generate responses that are seen at a single trial level, and they have underpinnings in the subplate-cortex interaction. This brings neonatal EEG readily into a multimodal study, where EEG is not only recording cortical function, but it also tests subplate function via different sensory modalities. Finally, introduction of clinically suitable dense array EEG caps, as well as amplifiers capable of recording low frequencies, have disclosed multitude of brain activities that have as yet been overlooked.
In the practical part of this video, we show how a multimodal, dense array EEG study is performed in neonatal intensive care unit from a preterm baby in the incubator. The video demonstrates preparation of the baby and incubator, application of the EEG cap, and performance of the sensory stimulations.
Neuroscience, Issue 60, neurophysiology, preterm baby, neonatal, EEG, evoked response, high density EEG, FbEEG, sensory evoked response, neonatal intensive care unit
A Neuroscientific Approach to the Examination of Concussions in Student-Athletes
Institutions: Elon University, Elon University, Duquesne University, Elon University.
Concussions are occurring at alarming rates in the United States and have become a serious public health concern. The CDC estimates that 1.6 to 3.8 million concussions occur in sports and recreational activities annually. Concussion as defined by the 2013 Concussion Consensus Statement “may be caused either by a direct blow to the head, face, neck or elsewhere on the body with an ‘impulsive’ force transmitted to the head.” Concussions leave the individual with both short- and long-term effects. The short-term effects of sport related concussions may include changes in playing ability, confusion, memory disturbance, the loss of consciousness, slowing of reaction time, loss of coordination, headaches, dizziness, vomiting, changes in sleep patterns and mood changes. These symptoms typically resolve in a matter of days. However, while some individuals recover from a single concussion rather quickly, many experience lingering effects that can last for weeks or months. The factors related to concussion susceptibility and the subsequent recovery times are not well known or understood at this time. Several factors have been suggested and they include the individual’s concussion history, the severity of the initial injury, history of migraines, history of learning disabilities, history of psychiatric comorbidities, and possibly, genetic factors. Many studies have individually investigated certain factors both the short-term and long-term effects of concussions, recovery time course, susceptibility and recovery. What has not been clearly established is an effective multifaceted approach to concussion evaluation that would yield valuable information related to the etiology, functional changes, and recovery. The purpose of this manuscript is to show one such multifaceted approached which examines concussions using computerized neurocognitive testing, event related potentials, somatosensory perceptual responses, balance assessment, gait assessment and genetic testing.
Medicine, Issue 94, Concussions, Student-Athletes, Mild Traumatic Brain Injury, Genetics, Cognitive Function, Balance, Gait, Somatosensory
Developing Neuroimaging Phenotypes of the Default Mode Network in PTSD: Integrating the Resting State, Working Memory, and Structural Connectivity
Institutions: Alpert Medical School, Brown University, University of Georgia.
Complementary structural and functional neuroimaging techniques used to examine the Default Mode Network (DMN) could potentially improve assessments of psychiatric illness severity and provide added validity to the clinical diagnostic process. Recent neuroimaging research suggests that DMN processes may be disrupted in a number of stress-related psychiatric illnesses, such as posttraumatic stress disorder (PTSD).
Although specific DMN functions remain under investigation, it is generally thought to be involved in introspection and self-processing. In healthy individuals it exhibits greatest activity during periods of rest, with less activity, observed as deactivation, during cognitive tasks, e.g.
, working memory. This network consists of the medial prefrontal cortex, posterior cingulate cortex/precuneus, lateral parietal cortices and medial temporal regions.
Multiple functional and structural imaging approaches have been developed to study the DMN. These have unprecedented potential to further the understanding of the function and dysfunction of this network. Functional approaches, such as the evaluation of resting state connectivity and task-induced deactivation, have excellent potential to identify targeted neurocognitive and neuroaffective (functional) diagnostic markers and may indicate illness severity and prognosis with increased accuracy or specificity. Structural approaches, such as evaluation of morphometry and connectivity, may provide unique markers of etiology and long-term outcomes. Combined, functional and structural methods provide strong multimodal, complementary and synergistic approaches to develop valid DMN-based imaging phenotypes in stress-related psychiatric conditions. This protocol aims to integrate these methods to investigate DMN structure and function in PTSD, relating findings to illness severity and relevant clinical factors.
Medicine, Issue 89, default mode network, neuroimaging, functional magnetic resonance imaging, diffusion tensor imaging, structural connectivity, functional connectivity, posttraumatic stress disorder
Aseptic Laboratory Techniques: Volume Transfers with Serological Pipettes and Micropipettors
Institutions: University of California, Los Angeles .
Microorganisms are everywhere - in the air, soil, and human body as well as on inanimate surfaces like laboratory benches and computer keyboards. The ubiquity of microbes creates a copious supply of potential contaminants in a laboratory. To ensure experimental success, the number of contaminants on equipment and work surfaces must be minimized. Common among many experiments in microbiology are techniques involving the measurement and transfer of cultures containing bacterial cells or viral particles. To do so without contacting non-sterile surfaces or contaminating sterile media requires (1) preparing a sterile workspace, (2) precisely setting and accurately reading instruments for aseptic transfer of liquids, and (3) properly manipulating instruments, cultures flasks, bottles and tubes within a sterile field. Learning these procedures calls for training and practice. At first, actions should be slow, deliberate, and controlled with the goal being for aseptic technique to become second nature when working at the bench. Here we present the steps for measuring volumes using serological pipettes and micropipettors within a sterile field created by a Bunsen burner. Volumes range from microliters (μl) to milliliters (ml) depending on the instrument used. Liquids commonly transferred include sterile broth or chemical solutions as well as bacterial cultures and phage stocks. By following these procedures, students should be able to: •Work within the sterile field created by the Bunsen burner flame. •Use serological pipettes without compromising instrument sterility.• Aspirate liquids with serological pipettes, precisely reading calibrated volumes by aligning the meniscus formed by the liquid to the graduation marks on the pipette. •Keep culture bottles, flasks, tubes and their respective caps sterile during liquid transfers. •Identify different applications for plastic versus glass serological pipettes. •State accuracy limitations for micropipettors. •Precisely and accurately set volumes on micropipettors. •Know how to properly use the first and second stop on a micropipettor to aspirate and transfer correct volumes.
Basic Protocols, Issue 63, Microbiology, Aseptic technique, sterile field, serological pipette, micropipettors, Pipetman, cell culture, contamination
Eye Movement Monitoring of Memory
Institutions: Rotman Research Institute, University of Toronto, University of Toronto.
Explicit (often verbal) reports are typically used to investigate memory (e.g. "Tell me what you remember about the person you saw at the bank yesterday."), however such reports can often be unreliable or sensitive to response bias 1
, and may be unobtainable in some participant populations. Furthermore, explicit reports only reveal when information has reached consciousness and cannot comment on when memories were accessed during processing, regardless of whether the information is subsequently accessed in a conscious manner. Eye movement monitoring (eye tracking) provides a tool by which memory can be probed without asking participants to comment on the contents of their memories, and access of such memories can be revealed on-line 2,3
. Video-based eye trackers (either head-mounted or remote) use a system of cameras and infrared markers to examine the pupil and corneal reflection in each eye as the participant views a display monitor. For head-mounted eye trackers, infrared markers are also used to determine head position to allow for head movement and more precise localization of eye position. Here, we demonstrate the use of a head-mounted eye tracking system to investigate memory performance in neurologically-intact and neurologically-impaired adults. Eye movement monitoring procedures begin with the placement of the eye tracker on the participant, and setup of the head and eye cameras. Calibration and validation procedures are conducted to ensure accuracy of eye position recording. Real-time recordings of X,Y-coordinate positions on the display monitor are then converted and used to describe periods of time in which the eye is static (i.e. fixations) versus in motion (i.e., saccades). Fixations and saccades are time-locked with respect to the onset/offset of a visual display or another external event (e.g. button press). Experimental manipulations are constructed to examine how and when patterns of fixations and saccades are altered through different types of prior experience. The influence of memory is revealed in the extent to which scanning patterns to new images differ from scanning patterns to images that have been previously studied 2, 4-5
. Memory can also be interrogated for its specificity; for instance, eye movement patterns that differ between an identical and an altered version of a previously studied image reveal the storage of the altered detail in memory 2-3, 6-8
. These indices of memory can be compared across participant populations, thereby providing a powerful tool by which to examine the organization of memory in healthy individuals, and the specific changes that occur to memory with neurological insult or decline 2-3, 8-10
Neuroscience, Issue 42, eye movement monitoring, eye tracking, memory, aging, amnesia, visual processing
How to Detect Amygdala Activity with Magnetoencephalography using Source Imaging
Institutions: University of Wisconsin-Milwaukee, Montreal Neurological Institute, McGill University, Medical College of Wisconsin .
In trace fear conditioning a conditional stimulus (CS) predicts the occurrence of the unconditional stimulus (UCS), which is presented after a brief stimulus free period (trace interval)1
. Because the CS and UCS do not co-occur temporally, the subject must maintain a representation of that CS during the trace interval. In humans, this type of learning requires awareness of the stimulus contingencies in order to bridge the trace interval2-4
. However when a face is used as a CS, subjects can implicitly learn to fear the face even in the absence of explicit awareness*. This suggests that there may be additional neural mechanisms capable of maintaining certain types of "biologically-relevant" stimuli during a brief trace interval. Given that the amygdala is involved in trace conditioning, and is sensitive to faces, it is possible that this structure can maintain a representation of a face CS during a brief trace interval.
It is challenging to understand how the brain can associate an unperceived face with an aversive outcome, even though the two stimuli are separated in time. Furthermore investigations of this phenomenon are made difficult by two specific challenges. First, it is difficult to manipulate the subject's awareness of the visual stimuli. One common way to manipulate visual awareness is to use backward masking. In backward masking, a target stimulus is briefly presented (< 30 msec) and immediately followed by a presentation of an overlapping masking stimulus5
. The presentation of the mask renders the target invisible6-8
. Second, masking requires very rapid and precise timing making it difficult to investigate neural responses evoked by masked stimuli using many common approaches. Blood-oxygenation level dependent (BOLD) responses resolve at a timescale too slow for this type of methodology, and real time recording techniques like electroencephalography (EEG) and magnetoencephalography (MEG) have difficulties recovering signal from deep sources.
However, there have been recent advances in the methods used to localize the neural sources of the MEG signal9-11
. By collecting high-resolution MRI images of the subject's brain, it is possible to create a source model based on individual neural anatomy. Using this model to "image" the sources of the MEG signal, it is possible to recover signal from deep subcortical structures, like the amygdala and the hippocampus*.
Behavior, Issue 76, Neuroscience, Neurobiology, Molecular Biology, Medicine, Physiology, Anatomy, Psychology, Amygdala, Magnetoencephalography, Fear, awareness, masking, source imaging, conditional stimulus, unconditional stimulus, hippocampus, brain, magnetic resonance imaging, MRI, fMRI, imaging, clinical techniques
Training Synesthetic Letter-color Associations by Reading in Color
Institutions: University of Amsterdam.
Synesthesia is a rare condition in which a stimulus from one modality automatically and consistently triggers unusual sensations in the same and/or other modalities. A relatively common and well-studied type is grapheme-color synesthesia, defined as the consistent experience of color when viewing, hearing and thinking about letters, words and numbers. We describe our method for investigating to what extent synesthetic associations between letters and colors can be learned by reading in color in nonsynesthetes. Reading in color is a special method for training associations in the sense that the associations are learned implicitly while the reader reads text as he or she normally would and it does not require explicit computer-directed training methods. In this protocol, participants are given specially prepared books to read in which four high-frequency letters are paired with four high-frequency colors. Participants receive unique sets of letter-color pairs based on their pre-existing preferences for colored letters. A modified Stroop task is administered before and after reading in order to test for learned letter-color associations and changes in brain activation. In addition to objective testing, a reading experience questionnaire is administered that is designed to probe for differences in subjective experience. A subset of questions may predict how well an individual learned the associations from reading in color. Importantly, we are not claiming that this method will cause each individual to develop grapheme-color synesthesia, only that it is possible for certain individuals to form letter-color associations by reading in color and these associations are similar in some aspects to those seen in developmental grapheme-color synesthetes. The method is quite flexible and can be used to investigate different aspects and outcomes of training synesthetic associations, including learning-induced changes in brain function and structure.
Behavior, Issue 84, synesthesia, training, learning, reading, vision, memory, cognition
Cortical Source Analysis of High-Density EEG Recordings in Children
Institutions: UCL Institute of Child Health, University College London.
EEG is traditionally described as a neuroimaging technique with high temporal and low spatial resolution. Recent advances in biophysical modelling and signal processing make it possible to exploit information from other imaging modalities like structural MRI that provide high spatial resolution to overcome this constraint1
. This is especially useful for investigations that require high resolution in the temporal as well as spatial domain. In addition, due to the easy application and low cost of EEG recordings, EEG is often the method of choice when working with populations, such as young children, that do not tolerate functional MRI scans well. However, in order to investigate which neural substrates are involved, anatomical information from structural MRI is still needed. Most EEG analysis packages work with standard head models that are based on adult anatomy. The accuracy of these models when used for children is limited2
, because the composition and spatial configuration of head tissues changes dramatically over development3
In the present paper, we provide an overview of our recent work in utilizing head models based on individual structural MRI scans or age specific head models to reconstruct the cortical generators of high density EEG. This article describes how EEG recordings are acquired, processed, and analyzed with pediatric populations at the London Baby Lab, including laboratory setup, task design, EEG preprocessing, MRI processing, and EEG channel level and source analysis.
Behavior, Issue 88, EEG, electroencephalogram, development, source analysis, pediatric, minimum-norm estimation, cognitive neuroscience, event-related potentials
Extracting Visual Evoked Potentials from EEG Data Recorded During fMRI-guided Transcranial Magnetic Stimulation
Institutions: Tel-Aviv University, Tel-Aviv University.
Transcranial Magnetic Stimulation (TMS) is an effective method for establishing a causal link between a cortical area and cognitive/neurophysiological effects. Specifically, by creating a transient interference with the normal activity of a target region and measuring changes in an electrophysiological signal, we can establish a causal link between the stimulated brain area or network and the electrophysiological signal that we record. If target brain areas are functionally defined with prior fMRI scan, TMS could be used to link the fMRI activations with evoked potentials recorded. However, conducting such experiments presents significant technical challenges given the high amplitude artifacts introduced into the EEG signal by the magnetic pulse, and the difficulty to successfully target areas that were functionally defined by fMRI. Here we describe a methodology for combining these three common tools: TMS, EEG, and fMRI. We explain how to guide the stimulator's coil to the desired target area using anatomical or functional MRI data, how to record EEG during concurrent TMS, how to design an ERP study suitable for EEG-TMS combination and how to extract reliable ERP from the recorded data. We will provide representative results from a previously published study, in which fMRI-guided TMS was used concurrently with EEG to show that the face-selective N1 and the body-selective N1 component of the ERP are associated with distinct neural networks in extrastriate cortex. This method allows us to combine the high spatial resolution of fMRI with the high temporal resolution of TMS and EEG and therefore obtain a comprehensive understanding of the neural basis of various cognitive processes.
Neuroscience, Issue 87, Transcranial Magnetic Stimulation, Neuroimaging, Neuronavigation, Visual Perception, Evoked Potentials, Electroencephalography, Event-related potential, fMRI, Combined Neuroimaging Methods, Face perception, Body Perception
Assessment and Evaluation of the High Risk Neonate: The NICU Network Neurobehavioral Scale
Institutions: Brown University, Women & Infants Hospital of Rhode Island, University of Massachusetts, Boston.
There has been a long-standing interest in the assessment of the neurobehavioral integrity of the newborn infant. The NICU Network Neurobehavioral Scale (NNNS) was developed as an assessment for the at-risk infant. These are infants who are at increased risk for poor developmental outcome because of insults during prenatal development, such as substance exposure or prematurity or factors such as poverty, poor nutrition or lack of prenatal care that can have adverse effects on the intrauterine environment and affect the developing fetus. The NNNS assesses the full range of infant neurobehavioral performance including neurological integrity, behavioral functioning, and signs of stress/abstinence. The NNNS is a noninvasive neonatal assessment tool with demonstrated validity as a predictor, not only of medical outcomes such as cerebral palsy diagnosis, neurological abnormalities, and diseases with risks to the brain, but also of developmental outcomes such as mental and motor functioning, behavior problems, school readiness, and IQ. The NNNS can identify infants at high risk for abnormal developmental outcome and is an important clinical tool that enables medical researchers and health practitioners to identify these infants and develop intervention programs to optimize the development of these infants as early as possible. The video shows the NNNS procedures, shows examples of normal and abnormal performance and the various clinical populations in which the exam can be used.
Behavior, Issue 90, NICU Network Neurobehavioral Scale, NNNS, High risk infant, Assessment, Evaluation, Prediction, Long term outcome
Fundamental Technical Elements of Freeze-fracture/Freeze-etch in Biological Electron Microscopy
Institutions: The University of North Carolina at Chapel Hill.
Freeze-fracture/freeze-etch describes a process whereby specimens, typically biological or nanomaterial in nature, are frozen, fractured, and replicated to generate a carbon/platinum “cast” intended for examination by transmission electron microscopy. Specimens are subjected to ultrarapid freezing rates, often in the presence of cryoprotective agents to limit ice crystal formation, with subsequent fracturing of the specimen at liquid nitrogen cooled temperatures under high vacuum. The resultant fractured surface is replicated and stabilized by evaporation of carbon and platinum from an angle that confers surface three-dimensional detail to the cast. This technique has proved particularly enlightening for the investigation of cell membranes and their specializations and has contributed considerably to the understanding of cellular form to related cell function. In this report, we survey the instrument requirements and technical protocol for performing freeze-fracture, the associated nomenclature and characteristics of fracture planes, variations on the conventional procedure, and criteria for interpretation of freeze-fracture images. This technique has been widely used for ultrastructural investigation in many areas of cell biology and holds promise as an emerging imaging technique for molecular, nanotechnology, and materials science studies.
Biophysics, Issue 91, Freeze-fracture; Freeze-etch; Membranes; Intercellular junctions; Materials science; Nanotechnology; Electron microscopy
Sample Preparation for Single Virion Atomic Force Microscopy and Super-resolution Fluorescence Imaging
Institutions: University of Utah, University of Utah.
Immobilization of virions to glass surfaces is a critical step in single virion imaging. Here we present a technique adopted from single molecule imaging assays which allows adhesion of single virions to glass surfaces with specificity. This preparation is based on grafting the surface of the glass with a mixture of PLL-g-PEG and PLL-g-PEG-Biotin, adding a layer of avidin, and finally creating virion anchors through attachment of biotinylated virus specific antibodies. We have applied this technique across a range of experiments including atomic force microscopy (AFM) and super-resolution fluorescence imaging. This sample preparation method results in a control adhesion of the virions to the surface.
Basic Protocol, Issue 83, AFM, Super-resolution fluorescence imaging, single virion imaging, fPALM, dSTORM, PALM
The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm
Institutions: Macquarie University, Macquarie University, Macquarie University.
The rubber hand illusion (RHI) is a popular experimental paradigm. Participants view touch on an artificial rubber hand while the participants' own hidden hand is touched. If the viewed and felt touches are given at the same time then this is sufficient to induce the compelling experience that the rubber hand is one's own hand. The RHI can be used to investigate exactly how the brain constructs distinct body representations for one's own body. Such representations are crucial for successful interactions with the external world. To obtain a subjective measure of the RHI, researchers typically ask participants to rate statements such as "I felt as if the rubber hand were my hand". Here we demonstrate how the crossmodal congruency task can be used to obtain an objective behavioral measure within this paradigm.
The variant of the crossmodal congruency task we employ involves the presentation of tactile targets and visual distractors. Targets and distractors are spatially congruent (i.e.
same finger) on some trials and incongruent (i.e.
different finger) on others. The difference in performance between incongruent and congruent trials - the crossmodal congruency effect (CCE) - indexes multisensory interactions. Importantly, the CCE is modulated both by viewing a hand as well as the synchrony of viewed and felt touch which are both crucial factors for the RHI.
The use of the crossmodal congruency task within the RHI paradigm has several advantages. It is a simple behavioral measure which can be repeated many times and which can be obtained during the illusion while participants view the artificial hand. Furthermore, this measure is not susceptible to observer and experimenter biases. The combination of the RHI paradigm with the crossmodal congruency task allows in particular for the investigation of multisensory processes which are critical for modulations of body representations as in the RHI.
Behavior, Issue 77, Neuroscience, Neurobiology, Medicine, Anatomy, Physiology, Psychology, Behavior and Behavior Mechanisms, Psychological Phenomena and Processes, Behavioral Sciences, rubber hand illusion, crossmodal congruency task, crossmodal congruency effect, multisensory processing, body ownership, peripersonal space, clinical techniques
Brain Imaging Investigation of the Impairing Effect of Emotion on Cognition
Institutions: University of Alberta, University of Alberta, University of Illinois, Duke University , Duke University , VA Medical Center, Yale University, University of Illinois, University of Illinois.
Emotions can impact cognition by exerting both enhancing
(e.g., better memory for emotional events) and impairing
(e.g., increased emotional distractibility) effects (reviewed in 1
). Complementing our recent protocol 2
describing a method that allows investigation of the neural correlates of the memory-enhancing effect of emotion (see also 1, 3-5
), here we present a protocol that allows investigation of the neural correlates of the detrimental impact of emotion on cognition. The main feature of this method is that it allows identification of reciprocal modulations between activity in a ventral neural system, involved in 'hot' emotion processing (HotEmo
system), and a dorsal system, involved in higher-level 'cold' cognitive/executive processing (ColdEx
system), which are linked to cognitive performance and to individual variations in behavior (reviewed in 1
). Since its initial introduction 6
, this design has proven particularly versatile and influential in the elucidation of various aspects concerning the neural correlates of the detrimental impact of emotional distraction on cognition, with a focus on working memory (WM), and of coping with such distraction 7,11
, in both healthy 8-11
and clinical participants 12-14
Neuroscience, Issue 60, Emotion-Cognition Interaction, Cognitive/Emotional Interference, Task-Irrelevant Distraction, Neuroimaging, fMRI, MRI
Electrophysiological Measurements and Analysis of Nociception in Human Infants
Institutions: University College London, Great Ormond Street Hospital, University College Hospital, University of Oxford.
Pain is an unpleasant sensory and emotional experience. Since infants cannot verbally report their experiences, current methods of pain assessment are based on behavioural and physiological body reactions, such as crying, body movements or changes in facial expression. While these measures demonstrate that infants mount a response following noxious stimulation, they are limited: they are based on activation of subcortical somatic and autonomic motor pathways that may not be reliably linked to central sensory processing in the brain. Knowledge of how the central nervous system responds to noxious events could provide an insight to how nociceptive information and pain is processed in newborns.
The heel lancing procedure used to extract blood from hospitalised infants offers a unique opportunity to study pain in infancy. In this video we describe how electroencephalography (EEG) and electromyography (EMG) time-locked to this procedure can be used to investigate nociceptive activity in the brain and spinal cord.
This integrative approach to the measurement of infant pain has the potential to pave the way for an effective and sensitive clinical measurement tool.
Neuroscience, Issue 58, pain, infant, electrophysiology, human development
Investigating Social Cognition in Infants and Adults Using Dense Array Electroencephalography (dEEG)
Institutions: University Toronto Scarborough.
Dense array electroencephalography (d
EEG), which provides a non-invasive window for measuring brain activity and a temporal resolution unsurpassed by any other current brain imaging technology1,2
, is being used increasingly in the study of social cognitive functioning in infants and adults. While d
EEG is enabling researchers to examine brain activity patterns with unprecedented levels of sensitivity, conventional EEG recording systems continue to face certain limitations, including 1) poor spatial resolution and source localization3,4
,2) the physical discomfort for test subjects of enduring the individual application of numerous electrodes to the surface of the scalp, and 3) the complexity for researchers of learning to use multiple software packages to collect and process data. Here we present an overview of an established methodology that represents a significant improvement on conventional methodologies for studying EEG in infants and adults. Although several analytical software techniques can be used to establish indirect indices of source localization to improve the spatial resolution of d
EEG, the HydroCel Geodesic Sensor Net (HCGSN) by Electrical Geodesics, Inc. (EGI), a dense sensory array that maintains equal distances among adjacent recording electrodes on all surfaces of the scalp, further enhances spatial resolution4,5,6
compared to standard d
EEG systems. The sponge-based HCGSN can be applied rapidly and without scalp abrasion, making it ideal for use with adults7,8
, and infants12
, in both research and clinical4,5,6,13,14,15
settings. This feature allows for considerable cost and time savings by decreasing the average net application time compared to other d
EEG systems. Moreover, the HCGSN includes unified, seamless software applications for all phases of data, greatly simplifying the collection, processing, and analysis of d
The HCGSN features a low-profile electrode pedestal, which, when filled with electrolyte solution, creates a sealed microenvironment and an electrode-scalp interface. In all Geodesic d
EEG systems, EEG sensors detect changes in voltage originating from the participant's scalp, along with a small amount of electrical noise originating from the room environment. Electrical signals from all sensors of the Geodesic sensor net are received simultaneously by the amplifier, where they are automatically processed, packaged, and sent to the data-acquisition computer (DAC). Once received by the DAC, scalp electrical activity can be isolated from artifacts for analysis using the filtering and artifact detection tools included in the EGI software. Typically, the HCGSN can be used continuously for only up to two hours because the electrolyte solution dries out over time, gradually decreasing the quality of the scalp-electrode interface.
In the Parent-Infant Research Lab at the University of Toronto, we are using d
EEG to study social cognitive processes including memory, emotion, goals, intentionality, anticipation, and executive functioning in both adult and infant participants.
Neuroscience, Issue 52, Developmental Affective Neuroscience, high density EEG, social cognition, infancy, and parenting