-1::1
Simple Hit Counter
Skip to content

Products

Solutions

×
×
Sign In

EN

EN - EnglishCN - 简体中文DE - DeutschES - EspañolKR - 한국어IT - ItalianoFR - FrançaisPT - Português do BrasilPL - PolskiHE - עִבְרִיתRU - РусскийJA - 日本語TR - TürkçeAR - العربية
Sign In Start Free Trial

RESEARCH

JoVE Journal

Peer reviewed scientific video journal

Behavior
Biochemistry
Bioengineering
Biology
Cancer Research
Chemistry
Developmental Biology
View All
JoVE Encyclopedia of Experiments

Video encyclopedia of advanced research methods

Biological Techniques
Biology
Cancer Research
Immunology
Neuroscience
Microbiology
JoVE Visualize

Visualizing science through experiment videos

EDUCATION

JoVE Core

Video textbooks for undergraduate courses

Analytical Chemistry
Anatomy and Physiology
Biology
Calculus
Cell Biology
Chemistry
Civil Engineering
Electrical Engineering
View All
JoVE Science Education

Visual demonstrations of key scientific experiments

Advanced Biology
Basic Biology
Chemistry
View All
JoVE Lab Manual

Videos of experiments for undergraduate lab courses

Biology
Chemistry

BUSINESS

JoVE Business

Video textbooks for business education

Accounting
Finance
Macroeconomics
Marketing
Microeconomics

OTHERS

JoVE Quiz

Interactive video based quizzes for formative assessments

Authors

Teaching Faculty

Librarians

K12 Schools

Biopharma

Products

RESEARCH

JoVE Journal

Peer reviewed scientific video journal

JoVE Encyclopedia of Experiments

Video encyclopedia of advanced research methods

JoVE Visualize

Visualizing science through experiment videos

EDUCATION

JoVE Core

Video textbooks for undergraduates

JoVE Science Education

Visual demonstrations of key scientific experiments

JoVE Lab Manual

Videos of experiments for undergraduate lab courses

BUSINESS

JoVE Business

Video textbooks for business education

OTHERS

JoVE Quiz

Interactive video based quizzes for formative assessments

Solutions

Authors
Teaching Faculty
Librarians
K12 Schools
Biopharma

Language

English

EN

English

CN

简体中文

DE

Deutsch

ES

Español

KR

한국어

IT

Italiano

FR

Français

PT

Português do Brasil

PL

Polski

HE

עִבְרִית

RU

Русский

JA

日本語

TR

Türkçe

AR

العربية

    Menu

    JoVE Journal

    Behavior

    Biochemistry

    Bioengineering

    Biology

    Cancer Research

    Chemistry

    Developmental Biology

    Engineering

    Environment

    Genetics

    Immunology and Infection

    Medicine

    Neuroscience

    Menu

    JoVE Encyclopedia of Experiments

    Biological Techniques

    Biology

    Cancer Research

    Immunology

    Neuroscience

    Microbiology

    Menu

    JoVE Core

    Analytical Chemistry

    Anatomy and Physiology

    Biology

    Calculus

    Cell Biology

    Chemistry

    Civil Engineering

    Electrical Engineering

    Introduction to Psychology

    Mechanical Engineering

    Medical-Surgical Nursing

    View All

    Menu

    JoVE Science Education

    Advanced Biology

    Basic Biology

    Chemistry

    Clinical Skills

    Engineering

    Environmental Sciences

    Physics

    Psychology

    View All

    Menu

    JoVE Lab Manual

    Biology

    Chemistry

    Menu

    JoVE Business

    Accounting

    Finance

    Macroeconomics

    Marketing

    Microeconomics

Start Free Trial
Loading...
Home
JoVE Journal
Behavior
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During S...
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During S...
JoVE Journal
Behavior
This content is Free Access.
JoVE Journal Behavior
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Full Text
11,567 Views
11:14 min
October 4, 2015

DOI: 10.3791/53406-v

Jesus G. Cruz-Garza1, Zachery R. Hernandez1, Teresa Tse1,2,3, Eunice Caducoy1,3, Berdakh Abibullaev1, Jose L. Contreras-Vidal1,2

1Laboratory for Noninvasive Brain-Machine Interface Systems, Department of Electrical and Computer Engineering,University of Houston, 2Department of Biomedical Engineering,University of Houston, 3Department of Biology and Biochemistry,University of Houston

This protocol presents a novel methodology for the neural decoding of intent from freely-behaving infants during unscripted social interaction with an actor. Neural activity is acquired using non-invasive high-density active scalp electroencephalography (EEG). Kinematic data is collected with inertial measurement units and supplemented with synchronized video recording.

The overall goal of this procedure is to capture brain activity and kinematic data from infants by integrating synchronized high density, active scalp electroencephalography, inertial measurement units and video recordings. This is accomplished by first placing the EEG cap on the infant's head and ensuring acceptable impedance levels between each electrode and the scalp. The second step is to secure inertial measurement units on the head, arms, and chest of the infant, as well as on the wrists of the experimenter.

Next, the experimenter interacts with the infant in an effort to initiate an imitation response, the final step is to digitize the 3D spatial coordinates of the EEG electrodes. Ultimately, the acquisition of EEG and kinematic data from freely behaving infants allows the investigation of the neural basis of cognitive motor development and the emergence of social cognition. In an advantage of this technique over other approaches that investigate social cognition is that we are able to acquire neural activity in action and in context during the first two years of life.

This method can help answer key questions in the cognitive neuroscience field, such as what are the intrinsic relationship between developmental changes in brain architecture and behavior? The implications of this technique extend towards therapy of social cognition problems and autism spectral disorders because it can be used to study developmental milestones and learning by imitation, how infants process visual actions, and how they engage in social communication. Though this method can provide insight into understanding the functioning of the mirror neuron system in the early human brain, it can also be applied to other cognitive systems, such as at attentive learning, language processing, and motor planning to study its emergence and development within the human brain.

Generally, individuals new to this method will struggle because some infants can become uncomfortable with a new environment, as well as with wearing the EEG cap Factors, such as sleepiness and hunger can also cost the infant to become impatient. Begin by escorting the parents of the infant into the experimental room and briefly explaining the purpose of the experiment. Record the age in months and sex of the infant.

Prepare the infant for the electroencephalogram or EEG by measuring the head circumference in centimeters. Place the measuring tape around the widest part of the head, passing it over the eyebrows and around the occipital prominence in the back of the head. Next, measure the distance from the nasn to the ian along the mid sagittal plane of the surface of the scalp.

Place the electrodes on an EEG cap as specified by the 10 20 international system. Then fit the cap onto the infant's head. Align the CZ electrode with the vertex of the head and center, the FP one and FP two electrodes on the forehead.

Adjust the EEG cap so that it symmetrically lies along the mid sagittal plane of the head. Next, connect the reference ground and recording electrodes to the control box. Turn on the impedance indicators, starting with the ground and reference electrodes.

Use a small syringe to inject electrolyte gel into the space between the scalp and the electrode. Ensure that the impedance level for electrode is below 60 kilo ohms. The electrodes turn yellow when the impedance goes below 60 kilo ohms.

If the impedance reaches below 25 kilo ohms, they turn green. Then connect the amplifiers to the host computer via A USB port using a fiber optic to USB converter. To prepare the inertial measurement units or imus open the IMU software.

Click new on the graphical interface and configure to configure the imus secure IMU straps on both wrists, the chest and the head of the infant. Then secure imus on both wrists of the experimenter. Finally, connect the trigger input output enclosure to the EEG and use.

Begin by placing the infant on the tabletop so that they are facing the actor. Ask the parent to sit on the chair behind the infant. Then record the initial impedance values of the EEG electrodes using the control software by selecting the impedance check tab, clicking the button impedance on, and then clicking save impedance.

To save the impedances open the EEG recording software and generate a workspace by setting the EEG channel. Select the folder to save the raw data in. Generate a file name.

Select the number of channels to use. Specify 1000 hertz as a sampling frequency and uncheck the enable filters option. Make sure to uncheck the option to enable segmentation To start recording EEG data.

Click on monitor, then play in the EEG recorder program. Next, click stream and record in the IMU recording software. To start recording kinematics data, apply three triggers to signal the start of the experiment using the push button on the input output enclosure.

Let the infant rest for one minute while recording the initial baseline data. Perform the experiment with the infant for approximately 15 minutes. Try to initiate an imitation response from the infant.

Note the variety of behaviors that the infant may elicit during the experiment, including reach, grasp, reach, offer, explore, observe and imitate. Apply five triggers on the input output enclosure to stop the experimenter when the infant gets tired, or after 15 minutes of interaction has passed in the EEG recording software. Click on stop data recording in the IMU software.

Click stop on the stream dialogue box to end the IMU recordings. Lastly, record the final impedance values by selecting the impedance check tab in the control software. Clicking the button impedance on and then clicking save impedance To save the impedances, digitize the 3D spatial coordinates of the EEG electrodes using the EEG electrode 3D scanner and software.

To do this, go to file and select new workspace in the software. Load the electrode position file in the first tab of the workspace. Then in the scanning toolbar, click start scanning.

Use the camera to scan the electrode locations by following the changing light patterns on the cap. For source imaging, acquire high resolution T one weighted magnetic resonance images from the neurodevelopmental MRI public database, which contains average MRI templates as a function of age for the first two years of life. Finally, coregister, EEG and MRI space to obtain the geometrical transformation by fitting the fiducial points indicated on the anatomical MRI and the fiducial points obtained with the 3D scanner.

Using the brain imaging software. This protocol presents a novel methodology for the neural decoding of intent from freely behaving infants during unscripted social interaction with an actor Here, EEG data histograms describe the distribution of the standardized signal from three spatially representative electrodes for each of the analyzed behaviors. EEG and IMU provide high temporal resolution neural data, which can predict behavioral actions in freely behaving infants.

Here, the classification accuracy for a 20 month old infant is shown in this confusion matrix. The overall decoding accuracy is 85.2%After watching this video, you should have a good understanding of how to collect DEG and kinematic data from failure behaving infants while they engage in social interaction with that experimenter. Once mastered, this technique can be done in one hour if performed properly.

While attempting this procedure, it's important to be mindful of how the infant reacts to the environment as it may be foreign to him or her distractions. A small child-friendly room and having fewer than four people in the room can help reduce any anxiety the infant may elicit from the new environment. Following this procedure, other methods like functional and effective connectivity can be performed in order to answer additional questions like, how's the interaction and coordination among brain regions contribute to brain functions?

We believe this novel technique will allow researchers in neuro cognitive rehabilitation engineering to explore brain activity in a disorder state such as autism.

Explore More Videos

Neural DecodingSocial InteractionInfant DevelopmentMultimodal NeuroimagingEEGIMUFreely-behavingGoal-oriented BehaviorExplorationCognitionPerceptionAction

Related Videos

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

10:45

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

Related Videos

12.2K Views

Investigating Social Cognition in Infants and Adults Using Dense Array Electroencephalography (dEEG)

12:48

Investigating Social Cognition in Infants and Adults Using Dense Array Electroencephalography (dEEG)

Related Videos

18.3K Views

Portable Intermodal Preferential Looking (IPL): Investigating Language Comprehension in Typically Developing Toddlers and Young Children with Autism

10:11

Portable Intermodal Preferential Looking (IPL): Investigating Language Comprehension in Typically Developing Toddlers and Young Children with Autism

Related Videos

19.1K Views

Corticospinal Excitability Modulation During Action Observation

12:33

Corticospinal Excitability Modulation During Action Observation

Related Videos

9.4K Views

A Within-subjects Experimental Protocol to Assess the Effects of Social Input on Infant EEG

08:20

A Within-subjects Experimental Protocol to Assess the Effects of Social Input on Infant EEG

Related Videos

8.3K Views

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Related Videos

8.2K Views

Gaze in Action: Head-mounted Eye Tracking of Children's Dynamic Visual Attention During Naturalistic Behavior

07:09

Gaze in Action: Head-mounted Eye Tracking of Children's Dynamic Visual Attention During Naturalistic Behavior

Related Videos

11.6K Views

Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm

06:07

Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm

Related Videos

9.2K Views

A Common Marmoset Model of Mother-Infant Intervention for Breastfeeding Disorders in the Presence of Paternal Inhibition and Maternal Neglect

05:04

A Common Marmoset Model of Mother-Infant Intervention for Breastfeeding Disorders in the Presence of Paternal Inhibition and Maternal Neglect

Related Videos

1.1K Views

Profiling Maternal Behavior Responses During Whole-Brain Imaging

07:12

Profiling Maternal Behavior Responses During Whole-Brain Imaging

Related Videos

1.5K Views

JoVE logo
Contact Us Recommend to Library
Research
  • JoVE Journal
  • JoVE Encyclopedia of Experiments
  • JoVE Visualize
Business
  • JoVE Business
Education
  • JoVE Core
  • JoVE Science Education
  • JoVE Lab Manual
  • JoVE Quizzes
Solutions
  • Authors
  • Teaching Faculty
  • Librarians
  • K12 Schools
  • Biopharma
About JoVE
  • Overview
  • Leadership
Others
  • JoVE Newsletters
  • JoVE Help Center
  • Blogs
  • JoVE Newsroom
  • Site Maps
Contact Us Recommend to Library
JoVE logo

Copyright © 2026 MyJoVE Corporation. All rights reserved

Privacy Terms of Use Policies
WeChat QR code