Methods to Test Visual Attention Online

Online data collection methods have particular appeal to behavioral scientists because they offer the promise of much larger and much more representative ...

University of Geneva

Although a large number of studies have demonstrated that a motor response to a visual stimulus is, at least to some extent, independent of the perceptual response, little effort has been spent on the investigation of the explicit characteristics of this independency. In the present experiment, observers were presented with an S1-S2 stimulus-pair, with S1 within the threshold range and with S2 highly suprathreshold. S2 was displayed either at the same location as S1 (masked condition), or some degree to the left or right of S1 (non-masked). Both the observers' sensitivity to S1 and simple RTs elicited by the stimulus pair were jointly assessed on a trial-by-trial basis. Response times decreased with increasing S1 contrast for perceptual Hits both when S1 was masked by S2 and when it was not, but for Misses only when S1 was masked, though to a lesser extent than for Hits. When RTs are collapsed across perceptual Hits and Misses for any given S1-contrast, they were independent of whether S1 was masked or not. The data indicate that the motor system has a fixed, high-energy threshold, whereas the perceptual system has a d'-dependent criterion that can either be higher or lower than the motor threshold-depending on the particular conditions.

Perceptual criterion and motor threshold: a signal detection analysis of the relationship between perception and action.

We present a simple reaction time (RT) versus temporal order judgment (TOJ) experiment as a test of the perception-action relationship. The experiment improves on previous ones in that it assesses for the first time RT and TOJ on a trial-by-trial basis, hence allowing the study of the two behaviors within the same task context and, most importantly, the association of RT to "correct" and "incorrect" TOJs. RTs to pairs of stimuli are significantly different depending on the associated TOJs, an indication that perceptual and motor decisions are based on the same internal response. Simulations with the simplest one-system model (J. Gibbon & R. Rutschmann, 1969) using the means and standard deviations of the RT to stimuli presented in isolation yield excellent fits of the mean RT to these increments when presented in sequence and moderately good fits of the RT when classified according to the TOJ categories. The present observation that the point of subjective simultaneity for stimulus pairs is systematically smaller than the difference in RT to each of the two increments in the same pairs pleads, however, in favor of distinct decision criteria for perception and action with the former below the latter. For such a case, standard one-system race models require that the internal noise associated with the TOJ be less than the one associated with the RT to the same stimulus pair. The present data show the reverse state of affairs. In short, data and simulations comply with "one-system-two-decision" models of perceptual and motor behaviors, while prompting further testing and modeling to account for the apparent discrepancy between the ordering of the two decisions.

Temporal order judgment and simple reaction times: evidence for a common processing system.

This study investigated the effects on perceptual and motor decisions of low-contrast distractors, presented 5 degrees on the left and/or the right of the fixation point. Perceptual decisions were assessed with a yes/no (distractor) detection task. Motor decisions were assessed via these distractors' effects on the trajectory of an impending saccade to a distinct imperative stimulus, presented 10 degrees above fixation 50 ms after the distractor(s). Saccade curvature models postulate that distractors activate loci on a motor map that evoke reflexive saccades and that the distractor evoked activity is inhibited to prevent reflexive orienting to the cost of causing a saccade curvature away from the distractor. Depending on whether or not each of these processes depends on perceptual detection, one can predict the relationships between saccades' curvature and perceptual responses (classified as correct rejections, misses, false alarms, and hits). The results show that saccades curve away from distractors only when observers report them to be present. Furthermore, saccade deviation is correlated (on a trial-by-trial basis) with the inferred internal response associated with the perceptual report: the stronger the distractor-evoked perceptual response, the more saccades deviate away from the distractor. Also in contrast with a supersensitive motor system, perceptual sensitivity is systematically higher than the motor sensitivity derived from the distributions of the saccades' curvatures. Finally, when both distractors are present (and straight saccades are expected), the sign of saccades' curvature is correlated with observers' perceptual bias/criterion. Overall the results point to a strong perceptual-motor association.

Comparison of perceptual and motor decisions via confidence judgments and saccade curvature.

To compare the timing of perceptual and motor decisions, distinct tasks have been designed, all of which have yielded systematic differences between these two moments. These observations have been taken as evidence of a sensorimotor dissociation. Inasmuch as the distinction between perceptual and motor decision moments is conceptually warranted, this conclusion remains debatable, since the observed differences may reflect the dissimilarity between the stimulations/tasks used to assess them. Here, we minimize such dissimilarities by comparing response time (RT) and anticipatory RT (ART), an alternative technique with which to infer the relative perceptual decision moments. Observers pressed a key either in synchrony with the third of a sequence of three stimuli appearing at a constant pace (ART) or in response to the onset of this third stimulus presented at a random interval after the second (RT). Hence, the two stimulation sequences were virtually identical. Both the mean and the variance of RT were affected by stimulus intensity about 1.5 times more than were the mean and the variance of ART. Within the framework of two simple integration-to-bound models, these findings are compatible with the hypothesis that perceptual and motor decisions operate on the same internal signal but are based on distinct criteria, with the perceptual criterion lower than the motor one.

Comparison of perceptual and motor latencies via anticipatory and reactive response times.

The metajudgment of motor responses refers to our ability to evaluate the accuracy of our own actions. Can humans metajudge the duration of their Reaction Times (RTs) to a light-flash and the accuracy of their reproduction of a reference time interval bounded by two light flashes (Anticipatory Response Time, ART)? A series of four distinct experiments shows that RT_Meta and ART_Metajudgments are possible but with accuracies about x2.4 and x3 poorer than the corresponding RT and ART ones. In order to reveal the origin of this drop in performance, we ask whether a visual feedback synchronous with subjects' key-presses could improve performance. We show that overall the presence of a visual feedback does not significantly improve metajudgment accuracy although such a trend is noticeable in ART_Meta. We then compare these performances with the passive perceptual estimation of the played back (Pb) RT and ART time intervals when bounded by two (RT_Pb) and three (ART_Pb) light flashes. We show that RT_Meta and RT_Pb accuracies are close to equal, but that ART_Meta is about x2 less accurate than ART_Pb which in turn is x1.5 less accurate than ART. The latter observation fails however to reach statistical significance hence not sustaining proposals that active time estimation is more reliable than passive one. The whole dataset is accounted for by a clock-type model where duration estimation performance is limited by four noise sources (visual, clock-count, motor and proprioceptive+efference copy) plus one proper to ART_Meta task. It is proposed that the latter reflects the impossibility for the time-counting system to use the same time origin more than once.

Introspective duration estimation of reactive and proactive motor responses.

With its roots in Ungerleider and Mishkin's (1982) uncovering of two distinct - ventral and dorsal - anatomical pathways for the processing of visual information, and boosted by Goodale and Milner's (1992; Milner and Goodale, 1995) behavioral study of patients with lesions of either of these pathways, the perception-action dissociation became a standard reference in the sensorimotor literature. Here we present briefly the anatomical, neuropsychological and, more extensively, the psychophysical evidence favoring such dissociation and pit it against counteracting evidence as well as against potential methodological and conceptual pitfalls. We also discuss classes of models accounting for a number of 'dissociation' results and conclude that the most general and parsimonious one posits the existence of one single processing stream that accumulates information up to a decision criterion modulated by stimulation conditions, response mode (motor vs. verbal/perceptual), task constraints (speeded vs. free time responses) and the nature of the task (detection, discrimination, temporal order judgment, etc.). The reviewed evidence is not meant to refute or validate the hypothesis of a perceptual-motor dissociation. Rather, its main objective is to show that, beyond its self-evidence, such dissociation is difficult if not impossible to test.

On the perceptual/motor dissociation: a review of concepts, theory, experimental paradigms and data interpretations.

The systematic association of an action that a person performs with its sensory effects is thought to attenuate that person's perception of the effect of the action. However, whether learned sensorimotor contingencies truly affect perception, rather than just inducing a response bias, has yet to be determined. The experiment presented in this article comprised two parts: an action-effect association phase and a test phase, during which the actions' perceptual effects were tested. During the association phase, specific actions (left-key and right-key presses) were associated with specific visual effects (tilted Gabor patches). In the test phase, participants' left-key presses and right-key presses triggered the onset of a low-contrast tilted Gabor patch in 50% of trials (no stimulus was presented on the remaining 50% of trials). Participants were required to report the presence or absence of this tilted Gabor patch. Our results showed that participants' sensitivity (d') to the Gabor patches was reduced by 10% when the patches were triggered by the action they had previously been associated with. This finding indicates that a person's action does not induce a response bias (c), but changes the perception (d') of the learned action effect.

A new look at sensory attenuation. Action-effect anticipation affects sensitivity, not response bias.

Voluntary actions are thought to be selected with respect to their intended goal. Converging data suggests that medial frontal cortex plays a crucial role in linking actions to their predicted effects. Recent neuroimaging data also suggests that during action selection, the brain pre-activities the representation of the predicted action effect. We review evidence of action effect prediction, both in terms of its neurophysiological basis as well as its functional consequences. By assuming that action preparation includes activation of the predicted sensory consequences of the action, we provide a mechanism to understand sensory attenuation and intentional binding. In this account, sensory attenuation results from more difficult discrimination between the observed action effect and the pre-activation of the predicted effect, as compared to when no (or incorrect) prediction is present. Similarly, a predicted action effect should also reach the threshold of awareness faster (intentional binding), if its perceptual representation is pre-activated. By comparing this potential mechanism to mental imagery and repetition suppression we propose a possible neural basis for the processing of predicted action effects.

Action effect anticipation: neurophysiological basis and functional consequences.

A thought-provoking new study has found that symptom-free carriers of the neurodegenerative Huntington's disease present a dramatic two-fold acceleration in perceptual learning.

Brain plasticity: Paradoxical case of a neurodegenerative disease?

The left dorsolateral prefrontal cortex (ldlPFC) has been highlighted as a key actor in human perceptual decision-making (PDM): It is theorized to support decision-formation independently of stimulus type or motor response. PDM studies however generally confound stimulus onset and task onset: when the to-be-recognized stimulus is presented, subjects know that a stimulus is shown and can set up processing resources-even when they do not know which stimulus is shown. We hypothesized that the ldlPFC might be involved in task preparation rather than decision-formation. To test this, we asked participants to report whether sequences of noisy images contained a face or a house within an experimental design that decorrelates stimulus and task onset. Decision-related processes should yield a sustained response during the task, whereas preparation-related areas should yield transient responses at its beginning. The results show that the brain activation pattern at task onset is strikingly similar to that observed in previous PDM studies. In particular, they contradict the idea that ldlPFC forms an abstract decision and suggest instead that its activation reflects preparation for the upcoming task. We further investigated the role of the fusiform face areas and parahippocampal place areas which are thought to be face and house detectors, respectively, that feed their signals to higher level decision areas. The response patterns within these areas suggest that this interpretation is unlikely and that the decisions about the presence of a face or a house in a noisy image might instead already be computed within these areas without requiring higher-order areas.

Human perceptual decision making: disentangling task onset and stimulus onset.

The notion that play may facilitate learning has long been touted. Here, we review how video game play may be leveraged for enhancing attentional control, allowing greater cognitive flexibility and learning and in turn new routes to better address developmental disorders.

Video game play, attention, and learning: how to shape the development of attention and influence learning?

A briefly flashed target stimulus can become "invisible" when immediately followed by a mask-a phenomenon known as backward masking, which constitutes a major tool in the cognitive sciences. One form of backward masking is termed metacontrast masking. It is generally assumed that in metacontrast masking, the mask suppresses activity on which the conscious perception of the target relies. This assumption biases conclusions when masking is used as a tool-for example, to study the independence between perceptual detection and motor reaction. This is because other models can account for reduced perceptual performance without requiring suppression mechanisms. In this study, we used signal detection theory to test the suppression model against an alternative view of metacontrast masking, referred to as the summation model. This model claims that target- and mask-related activations fuse and that the difficulty in detecting the target results from the difficulty to discriminate this fused response from the response produced by the mask alone. Our data support this alternative view. This study is not a thorough investigation of metacontrast masking. Instead, we wanted to point out that when a different model is used to account for the reduced perceptual performance in metacontrast masking, there is no need to postulate a dissociation between perceptual and motor responses to account for the data. Metacontrast masking, as implemented in the Fehrer-Raab situation, therefore is not a valid method to assess perceptual-motor dissociations.

Article	Year
Perceptual criterion and motor threshold: a signal detection analysis of the relationship between perception and action. Experimental brain research\| PubMed ID: 17562032	2007
Temporal order judgment and simple reaction times: evidence for a common processing system. Journal of vision\| PubMed ID: 17685794	2007
Comparison of perceptual and motor decisions via confidence judgments and saccade curvature. Journal of neurophysiology\| PubMed ID: 19261707	2009
Comparison of perceptual and motor latencies via anticipatory and reactive response times. Attention, perception & psychophysics\| PubMed ID: 19304599	2009
Introspective duration estimation of reactive and proactive motor responses. Acta psychologica\| PubMed ID: 20170893	2010
On the perceptual/motor dissociation: a review of concepts, theory, experimental paradigms and data interpretations. Seeing and perceiving\| PubMed ID: 20550823	2010
A new look at sensory attenuation. Action-effect anticipation affects sensitivity, not response bias. Psychological science\| PubMed ID: 21119181	2010
Action effect anticipation: neurophysiological basis and functional consequences. Neuroscience and biobehavioral reviews\| PubMed ID: 22108008	2012
Brain plasticity: Paradoxical case of a neurodegenerative disease? Current biology : CB\| PubMed ID: 23098600	2012
Human perceptual decision making: disentangling task onset and stimulus onset. Human brain mapping\| PubMed ID: 24142534	2014
Video game play, attention, and learning: how to shape the development of attention and influence learning? Current opinion in neurology\| PubMed ID: 24553464	2014
Summation versus suppression in metacontrast masking: On the potential pitfalls of using metacontrast masking to assess perceptual-motor dissociation. Attention, perception & psychophysics\| PubMed ID: 24719237	2014

Pedro Cardoso-Leite

Biography

JoVE Journal Publications

Other Publications