using-virtual-reality-to-transfer-motor-skill-knowledge-from-one-hand

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

As far as acquiring motor skills is concerned, training by voluntary physical movement is superior to all other forms of training (e.g. training by ...

Tel-Aviv University

A key computation underlying perceptual decisions is the temporal integration of "evidence" in favor of different states of the world. Studies from psychology and neuroscience have shown that observers integrate multiple samples of noisy perceptual evidence over time toward a decision. An influential model posits perfect evidence integration (i.e., without forgetting), enabling optimal decisions based on stationary evidence. However, in real-life environments, the perceptual evidence typically changes continuously. We used a computational model to show that, under such conditions, performance can be improved by means of leaky (forgetful) integration, if the integration timescale is adapted toward the predominant signal duration. We then tested whether human observers employ such an adaptive integration process. Observers had to detect visual luminance "signals" of variable strength, duration, and onset latency, embedded within longer streams of noise. Different sessions entailed predominantly short or long signals. The rate of performance improvement as a function of signal duration indicated that observers indeed changed their integration timescale with the predominant signal duration, in accordance with the adaptive integration account. Our findings establish that leaky integration of perceptual evidence is flexible and that cognitive control mechanisms can exploit this flexibility for optimizing the decision process.

The timescale of perceptual evidence integration can be adapted to the environment.

A fundamental computation underlying visual word recognition is the ability to transform a set of letters into a visual word form. Neuropsychological data suggest that letter position within a word may be independently affected by brain damage, resulting in a dissociable subtype of peripheral dyslexia. Here we used functional magnetic resonance imaging and supervised machine learning techniques to classify letter position based on activation patterns evoked during reading Hebrew words. Across the entire brain, activity patterns in the left intraparietal sulcus provided the best classification accuracy (80%) with respect to letter position. Importantly, the same set of voxels that showed highest classification performance of letter position using one letter-of-interest also showed highest classification performance using a different letter-of-interest. A functional connectivity analysis revealed that activity in these voxels co-varied with activity in the Visual Word Form Area, confirming cross-talk between these regions during covert reading. The results converge with reports of patients with acquired letter position dyslexia, who suffer from left occipito-parietal lesions. These findings provide direct and novel evidence for the role of left IPS within the reading network in processing relative letter positions.

Decoding letter position in word reading.

Accumulating evidence demonstrates that responses in auditory cortex to auditory consequences of self-generated actions are modified relative to the responses evoked by identical sounds generated by an external source. Such modifications have been suggested to occur through a corollary discharge sent from the motor system, although the exact neuroanatomical origin is unknown. Furthermore, since tactile input has also been shown to modify responses in auditory cortex, it is not even clear whether the source of such modifications is motor output or somatosensory feedback. We recorded functional magnetic resonance imaging (fMRI) data from healthy human subjects (n = 11) while manipulating the rate at which they performed sound-producing actions with their right hand. In addition, we manipulated the amount of tactile feedback to examine the relative roles of motor and somatosensory cortices in modifying evoked activity in auditory cortex (superior temporal gyrus). We found an enhanced fMRI signal in left auditory cortex during perception of self-generated sounds relative to passive listening to identical sounds. Moreover, the signal difference between active and passive conditions in left auditory cortex covaried with the rate of sound-producing actions and was invariant to the amount of tactile feedback. Together with functional connectivity analysis, our results suggest motor output from supplementary motor area and left primary motor cortex as the source of signal modification in auditory cortex during perception of self-generated sounds. Motor signals from these regions could represent a predictive signal of the expected auditory consequences of the performed action.

Enhanced auditory evoked activity to self-generated sounds is mediated by primary and supplementary motor cortices.

Deciphering the content of continuous speech is a challenging task performed daily by the human brain. Here, we tested whether activity of single cells in auditory cortex could be used to support such a task. We recorded neural activity from auditory cortex of two neurosurgical patients while presented with a short video segment containing speech. Population spiking activity (~20 cells per patient) allowed detection of word onset and decoding the identity of perceived words with significantly high accuracy levels. Oscillation phase of local field potentials (8-12Hz) also allowed decoding word identity although with lower accuracy levels. Our results provide evidence that the spiking activity of a relatively small population of cells in human primary auditory cortex contains significant information for classification of words in ongoing speech. Given previous evidence for overlapping neural representation during speech perception and production, this may have implications for developing brain-machine interfaces for patients with deficits in speech production.

Decoding speech perception from single cell activity in humans.

A dominant concept in motor cognition associates action observation with motor control. Previous studies have shown that passive action observation can result in significant performance gains in humans. Nevertheless, it is unclear whether the neural mechanism subserving such learning codes abstract aspects of the action (e.g. goal) or low level aspects such as effector identity. Eighteen healthy subjects learned to perform sequences of finger movements by passively observing right or left hand performing the same sequences in egocentric view. Using functional magnetic resonance imaging we show that during passive observation, activity in the superior parietal lobule (SPL) contralateral to the identity of the observed hand (right\left), predicts subsequent performance gains in individual subjects. Behaviorally, left hand observation resulted in positively correlated performance gains of the two hands. Conversely right hand observation yielded negative correlation - individuals with high performance gains in one hand exhibited low gains in the other. Such behavioral asymmetry is reflected by activity in contralateral SPL during short-term training in the absence of overt physical practice and demonstrates the role of observed hand identity in learning. These results shed new light on the coding level in SPL and have implications for optimizing motor skill learning.

Activity in superior parietal cortex during training by observation predicts asymmetric learning levels across hands.

Physical practice with one hand results in performance gains of the other (un-practiced) hand, yet the role of sensory feedback and underlying neurophysiology is unclear. Healthy subjects learned sequences of finger movements by physical training with their right hand while receiving real-time movement-based visual feedback via 3D virtual reality devices as if their immobile left hand was training. This manipulation resulted in significantly enhanced performance gain with the immobile hand, which was further increased when left-hand fingers were yoked to passively follow right-hand voluntary movements. Neuroimaging data show that, during training with manipulated visual feedback, activity in the left and right superior parietal lobule and their degree of coupling with motor and visual cortex, respectively, correlate with subsequent left-hand performance gain. These results point to a neural network subserving short-term motor skill learning and may have implications for developing new approaches for learning and rehabilitation in patients with unilateral motor deficits.

Neural Network Underlying Intermanual Skill Transfer in Humans.

Visual feedback in general, and from the body in particular, is known to influence the performance of motor skills in humans. However, it is unclear how the acquisition of motor skills depends on specific visual feedback parameters such as the size of performing effector. Here, 21 healthy subjects physically trained to perform sequences of finger movements with their right hand. Through the use of 3D Virtual Reality devices, visual feedback during training consisted of virtual hands presented on the screen, tracking subject's hand movements in real time. Importantly, the setup allowed us to manipulate the size of the displayed virtual hands across experimental conditions. We found that performance gains increase with the size of virtual hands. In contrast, when subjects trained by mere observation (i.e., in the absence of physical movement), manipulating the size of the virtual hand did not significantly affect subsequent performance gains. These results demonstrate that when it comes to short-term motor skill learning, the size of visual feedback matters. Furthermore, these results suggest that highest performance gains in individual subjects are achieved when the size of the virtual hand matches their real hand size. These results may have implications for optimizing motor training schemes.

Article	Year
The timescale of perceptual evidence integration can be adapted to the environment. Current biology : CB\| PubMed ID: 23684972	2013
Decoding letter position in word reading. Cortex; a journal devoted to the study of the nervous system and behavior\| PubMed ID: 25133927	2014
Enhanced auditory evoked activity to self-generated sounds is mediated by primary and supplementary motor cortices. The Journal of neuroscience : the official journal of the Society for Neuroscience\| PubMed ID: 25653372	2015
Decoding speech perception from single cell activity in humans. NeuroImage\| PubMed ID: 25976925	2015
Activity in superior parietal cortex during training by observation predicts asymmetric learning levels across hands. Scientific reports\| PubMed ID: 27535179	2016
Neural Network Underlying Intermanual Skill Transfer in Humans. Cell reports\| PubMed ID: 27974204	2016
Short Term Motor-Skill Acquisition Improves with Size of Self-Controlled Virtual Hands. PloS one\| PubMed ID: 28056023	2017

Ori Ossmy

Biography

JoVE Journal Publications

Other Publications