a-two-interval-forced-choice-task-for-multisensory-comparisons

A Two-interval Forced-choice Task for Multisensory Comparisons

We provide a procedure for a psychophysics experiment in humans based on a previously described paradigm aimed to characterize the perceptual duration of ...

Universidad Nacional Autónoma de México

Key to understanding somatosensation is the form of how the mechanical stimuli are represented in the evoked neuronal activity of the brain. Here, we focus on studies that address the question of which components of the evoked neuronal activity in the somatosensory system represent the stimulus features. We review experiments that probe whether these neuronal representations are essential to somatosensation. We also discuss recent results that suggest how the somatosensory stimuli are represented in the brain during short-term memory. Finally, we review data that show the neuronal correlates of a decision during somatosensory perception.

From sensation to action.

The ability to discriminate between two sequential stimuli requires evaluation of current sensory information in reference to stored information. Where and how does this evaluation occur? We trained monkeys to compare two mechanical vibrations applied sequentially to the fingertips and to report which of the two had the higher frequency. We recorded single neurons in secondary somatosensory cortex (S2) while the monkeys performed the task. During the first stimulus period, the firing rate of S2 neurons encoded the stimulus frequency. During the second stimulus period, however, some S2 neurons did not merely encode the stimulus frequency. The responses of these neurons were a function of both the remembered (first) and current (second) stimulus. Moreover, a few hundred milliseconds after the presentation of the second stimulus, these responses were correlated with the monkey's decision. This suggests that some S2 neurons may combine past and present sensory information for decision-making.

Neuronal correlates of decision-making in secondary somatosensory cortex.

Most perceptual tasks require sequential steps to be carried out. This must be the case, for example, when subjects discriminate the difference in frequency between two mechanical vibrations applied sequentially to their fingertips. This perceptual task can be understood as a chain of neural operations: encoding the two consecutive stimulus frequencies, maintaining the first stimulus in working memory, comparing the second stimulus to the memory trace left by the first stimulus, and communicating the result of the comparison to the motor apparatus. Where and how in the brain are these cognitive operations executed? We addressed this problem by recording single neurons from several cortical areas while trained monkeys executed the vibrotactile discrimination task. We found that primary somatosensory cortex (S1) drives higher cortical areas where past and current sensory information are combined, such that a comparison of the two evolves into a decision. Consistent with this result, direct activation of the S1 can trigger quantifiable percepts in this task. These findings provide a fairly complete panorama of the neural dynamics that underlies the transformation of sensory information into an action and emphasize the importance of studying multiple cortical areas during the same behavioural task.

Decoding the temporal evolution of a simple perceptual act.

Depending on environmental demands, a decision based on a sensory evaluation may be either immediately reported or postponed for later report. If postponed, the decision must be held in memory. But what exactly is stored by the underlying memory circuits, the final decision itself or the sensory information that led to it? Here, we report that, during a postponed decision report period, the activity of medial premotor cortex neurons encodes both the result of the sensory evaluation that corresponds to the monkey's possible choices and past sensory information on which the decision is based. These responses could switch back and forth with remarkable flexibility across the postponed decision report period. Moreover, these responses covaried with the animal's decision report. We propose that maintaining in working memory the original stimulus information on which the decision is based could serve to continuously update the postponed decision report in this task.

Neural correlates of a postponed decision report.

We report a procedure for recording the simultaneous activity of single neurons distributed across five cortical areas in behaving monkeys. The procedure consists of a commercially available microdrive adapted to a commercially available neural data collection system. The critical advantage of this procedure is that, in each cortical area, a configuration of seven microelectrodes spaced 250-500 mum can be inserted transdurally and each can be moved independently in the z axis. For each microelectrode, the data collection system can record the activity of up to five neurons together with the local field potential (LFP). With this procedure, we normally monitor the simultaneous activity of 70-100 neurons while trained monkeys discriminate the difference in frequency between two vibrotactile stimuli. Approximately 20-60 of these neurons have response properties previously reported in this task. The neuronal recordings show good signal-to-noise ratio, are remarkably stable along a 1-day session, and allow testing several protocols. Microelectrodes are removed from the brain after a 1-day recording session, but are reinserted again the next day by using the same or different x-y microelectrode array configurations. The fact that microelectrodes can be moved in the z axis during the recording session and that the x-y configuration can be changed from day to day maximizes the probability of studying simultaneous interactions, both local and across distant cortical areas, between neurons associated with the different components of this task.

Procedure for recording the simultaneous activity of single neurons distributed across cortical areas during sensory discrimination.

We recorded from single neurons of the primary auditory cortex (A1), while trained monkeys reported a decision based on the comparison of 2 acoustic flutter stimuli. Crucially, to form the decision, monkeys had to compare the second stimulus rate to the memory trace of the first stimulus rate. We found that the responses of A1 neurons encode stimulus rates both through their periodicity and through their firing rates during the stimulation periods, but not during the working memory and decision components of this task. Neurometric thresholds based on firing rate were very similar to the monkey's discrimination thresholds, whereas neurometric thresholds based on periodicity were lower than the experimental thresholds. Thus, an observer could solve this task with a precision similar to that of the monkey based only on the firing rates evoked by the stimuli. These results suggest that the A1 is exclusively associated with the sensory and not with the cognitive components of this task.

Neural codes for perceptual discrimination of acoustic flutter in the primate auditory cortex.

Monkeys have the capacity to accurately discriminate the difference between two acoustic flutter stimuli. In this task, monkeys must compare information about the second stimulus to the memory trace of the first stimulus, and must postpone the decision report until a sensory cue triggers the beginning of the decision motor report. The neuronal processes associated with the different components of this task have been investigated in the primary auditory cortex (A1); but, A1 seems exclusively associated with the sensory and not with the working memory and decision components of this task. Here, we show that ventral premotor cortex (VPC) neurons reflect in their activities the current and remembered acoustic stimulus, their comparison, and the result of the animal's decision report. These results provide evidence that the neural dynamics of VPC is involved in the processing steps that link sensation and decision-making during auditory discrimination.

Neural encoding of auditory discrimination in ventral premotor cortex.

We examined neural spike recordings from prefrontal cortex (PFC) while monkeys performed a delayed somatosensory discrimination task. In general, PFC neurons displayed great heterogeneity in response to the task. That is, although individual cells spiked reliably in response to task variables from trial-to-trial, each cell had idiosyncratic combinations of response properties. Despite the great variety in response types, some general patterns held. We used linear regression analysis on the spike data to both display the full heterogeneity of the data and classify cells into categories. We compared different categories of cells and found little difference in their ability to carry information about task variables or their correlation to behavior. This suggests a distributed neural code for the task rather than a highly modularized one. Along this line, we compared the predictions of two theoretical models to the data. We found that cell types predicted by both models were not represented significantly in the population. Our study points to a different class of models that should embrace the inherent heterogeneity of the data, but should also account for the nonrandom features of the population.

Heterogenous population coding of a short-term memory and decision task.

Perceptual decisions arise from the activity of neurons distributed across brain circuits. But, decoding the mechanisms behind this cognitive operation across brain circuits has long posed a difficult problem. We recorded the neuronal activity of diverse cortical areas, while monkeys performed a vibrotactile discrimination task. We find that the encoding of the stimuli during the stimulus periods, working memory, and comparison periods is widely distributed across cortical areas. Notably, during the comparison and postponed decision report periods the activity of frontal brain circuits encode both the result of the sensory evaluation that corresponds to the monkey's possible choices and past information on which the decision is based. These results suggest that frontal lobe circuits are more engaged in the readout of sensory information from working memory, when it is required to be compared with other sensory inputs, than simply engaged in motor responses during this task.

Decoding a perceptual decision process across cortex.

Recent studies have reported that sensory cortices process more than one sensory modality, challenging the long-lasting concept that they process only one. However, both the identity of these multimodal responses and whether they contribute to perceptual judgments is unclear. We recorded from single neurons in somatosensory cortices and primary auditory cortex while trained monkeys discriminated, on interleaved trials, either between two tactile flutter stimuli or between two acoustic flutter stimuli, and during discrimination sets that combined these two sensory modalities. We found neurons in these sensory cortices that responded to stimuli that are not of their principal sensory modality during these tasks. However, the identity of the stimulus could only be decoded from responses to their principal sensory modality during the stimulation periods and not during the processing steps that link sensation and decision making. These results suggest that multimodal encoding and perceptual judgments in these tasks occur outside the sensory cortices studied here.

Do sensory cortices process more than one sensory modality during perceptual judgments?

The brain constructs representations of objects and concepts based in sensory information combined with experience. This mental process, that we call perception, is the result of a chain of events consisting of phenomena such as detection, memory, discrimination, categorization and decision-making. Although the phenomenon of perception is not necessarily dependent on a given sensory modality (e.g. visual perception, auditory, tactile), single sensory models are indispensable for studying the neural mechanisms that generate it. The somatosensory system is a suitable model for studying the manner in which presentation of a single physical variable (e.g. vibration) triggers a perceptual process. Here, we discuss some recent studies in the somatosensory system that in our view, constitute a breakthrough to understanding decision making.

Sense, memory, and decision-making in the somatosensory cortical network.

The family of Transient Receptor Potential (TRP) ion channels is constituted by 7 subfamilies among which are those that respond to temperature, the thermoTRPs. These channels are versatile molecules of a polymodal nature that have been shown to be modulated in various fashions by molecules of a lipidic nature. Some of these molecules interact directly with the channels on specific regions of their structures and some of these promote changes in membrane fluidity or modify their gating properties in response to their agonists. Here, we have discussed how some of these lipids regulate the activity of thermoTRPs and included some of the available evidence for the molecular mechanisms underlying their effects on these channels.

Regulation of thermoTRPs by lipids.

The ability to estimate time intervals subserves many of our behaviors and perceptual experiences. However, it is not clear how aperiodic (AP) stimuli affect our perception of time intervals across sensory modalities. To address this question, we evaluated the human capacity to discriminate between two acoustic (A), visual (V) or audiovisual (AV) time intervals of trains of scattered pulses. We first measured the periodicity of those stimuli and then sought for correlations with the accuracy and reaction times (RTs) of the subjects. We found that, for all time intervals tested in our experiment, the visual system consistently perceived AP stimuli as being shorter than the periodic (P) ones. In contrast, such a compression phenomenon was not apparent during auditory trials. Our conclusions are: first, the subjects exposed to P stimuli are more likely to measure their durations accurately. Second, perceptual time compression occurs for AP visual stimuli. Lastly, AV discriminations are determined by A dominance rather than by AV enhancement.

The Time Is Up: Compression of Visual Time Interval Estimations of Bimodal Aperiodic Patterns.

Previous work on perceptual decision making in the sensorimotor system has shown population dynamics in the beta band, corresponding to the encoding of stimulus properties and the final decision outcome. Here, we asked how oscillatory dynamics in the medial premotor cortex (MPC) contribute to supramodal perceptual decision making. We recorded local field potentials (LFPs) and spikes in two monkeys trained to perform a tactile-acoustic frequency discrimination task, including both unimodal and crossmodal conditions. We studied the role of oscillatory activity as a function of stimulus properties (frequency and sensory modality), as well as decision outcome. We found that beta-band power correlated with relevant stimulus properties: there was a significant modulation by stimulus frequency during the working-memory (WM) retention interval, as well as modulation by stimulus modality-the latter was observed only in the case of a purely unimodal task, where modality information was relevant to prepare for the upcoming second stimulus. Furthermore, we found a significant modulation of beta power during the comparison and decision period, which was predictive of decision outcome. Finally, beta-band spike-field coherence (SFC) matched these LFP observations. In conclusion, we demonstrate that beta power in MPC is reflective of stimulus features in a supramodal, context-dependent manner, and additionally reflects the decision outcome. We propose that these beta modulations are a signature of the recruitment of functional neuronal ensembles, which encode task-relevant information.

Article	Year
From sensation to action. Behavioural brain research\| PubMed ID: 12356440	2002
Neuronal correlates of decision-making in secondary somatosensory cortex. Nature neuroscience\| PubMed ID: 12368806	2002
Decoding the temporal evolution of a simple perceptual act. Novartis Foundation symposium\| PubMed ID: 16649714	2006
Neural correlates of a postponed decision report. Proceedings of the National Academy of Sciences of the United States of America\| PubMed ID: 17940014	2007
Procedure for recording the simultaneous activity of single neurons distributed across cortical areas during sensory discrimination. Proceedings of the National Academy of Sciences of the United States of America\| PubMed ID: 18946031	2008
Neural codes for perceptual discrimination of acoustic flutter in the primate auditory cortex. Proceedings of the National Academy of Sciences of the United States of America\| PubMed ID: 19458263	2009
Neural encoding of auditory discrimination in ventral premotor cortex. Proceedings of the National Academy of Sciences of the United States of America\| PubMed ID: 19667191	2009
Heterogenous population coding of a short-term memory and decision task. The Journal of neuroscience : the official journal of the Society for Neuroscience\| PubMed ID: 20089900	2010
Decoding a perceptual decision process across cortex. Neuron\| PubMed ID: 20435005	2010
Do sensory cortices process more than one sensory modality during perceptual judgments? Neuron\| PubMed ID: 20670839	2010
Sense, memory, and decision-making in the somatosensory cortical network. Current opinion in neurobiology\| PubMed ID: 22939031	2012
Regulation of thermoTRPs by lipids. Temperature (Austin, Tex.)\| PubMed ID: 28349093	2017
The Time Is Up: Compression of Visual Time Interval Estimations of Bimodal Aperiodic Patterns. Frontiers in integrative neuroscience\| PubMed ID: 28848406	2017
Beta oscillations reflect supramodal information during perceptual judgment. Proceedings of the National Academy of Sciences of the United States of America\| PubMed ID: 29229820	2017

Luis Lemus

Biography

JoVE Journal Publications

Other Publications