Spatial Cueing

Sensation and Perception

Your institution must subscribe to JoVE's Psychology collection to access this content.

Fill out the form below to receive a free trial or learn more about access:

Welcome!

Enter your email below to get your free 1 hour trial to JoVE!





By clicking "Submit", you agree to our policies.

 

Overview

Source: Laboratory of Jonathan Flombaum—Johns Hopkins University

Attention refers to the limited human ability to select some information for processing at the expense of other stimuli in the environment. Attention operates in all sensory modalities: vision, hearing, touch, even taste and smell. It is most often studied in the visual domain though. A common way to study visual attention is with a spatial cueing paradigm. This paradigm allows researchers to measure the consequences of focusing visual attention in some locations and not others. This paradigm was developed by psychologist Michael Posner in the late 70s and early 80s in a series of papers in which he likened attention to a spotlight, selectively illuminating some portion of a scene.1,2 This video demonstrates standard procedures for a spatial cueing experiment to investigate visual attention.

Cite this Video

JoVE Science Education Database. Sensation and Perception. Spatial Cueing. JoVE, Cambridge, MA, (2017).

Procedure

1. Equipment

  1. The experiment requires a computer and experiment implementation software such as E-Prime, or a programming environment such as MATLAB or PsychoPy.

2. Stimulus and Experiment Design

  1. The experiment involves short trials in which participants must detect and report a brief visual target. Each trial comprises three frames. Figure 1 depicts the frames.

Figure 1
Figure 1. Sequence of events in the spatial cueing paradigm used to measure the consequences of visual attention. Each trial begins the same way, as shown in frame one, with a central fixation cross and two green boxes on either side. In frame two, the fixation cross is replaced by an arrow, pointing to one of the two boxes (50% of the time each). Finally, in frame three a letter is shown-either an L or a T-in one of the two boxes. In the example shown, the letter is an L. In the right panel example, the letter appears in the box that the arrow points to, producing a congruent trial. In the panel on the left, the letter appears opposite the arrow, producing an incongruent trial. The measure of interest is the time it takes a participant to make a correct response (the reaction time), in particular, the average difference between congruent and incongruent trials.

  1. In frame one, there are two green boxes, 1.0 in. x 1.0 in. on either side of the display, centered vertically. In addition, there is a red fixation cross made of 0.5 in. long lines, located exactly in the center of the display. The green boxes should be about 1.5 in. away from the edges of the display.
  2. In the second frame, the fixation cross is replaced by a cue, an arrow that points at one of the two green boxes. Make the arrow red, and easy to see, as shown in Figure 1.
  3. In frame three, a 'T' or 'L' is added to one of the two boxes, and the arrow from frame two is replaced by the reappearance of the fixation cross.
    1. The participant's task is to indicate whether the letter in the box is an 'L' or a 'T' using the appropriate keys. Each letter will appear 50% of the time.
    2. In 80% of the trials, the letter appears in the box that the arrow points to in frame two. These are called congruent trials. In the remaining 20% of trials, the letter appears opposite the arrow's direction. These are called incongruent trials.
    3. Overall, the letters will appear equally often on the right or left.
  4. Sequence the experiment, just as described, to include the correct proportions of congruent and incongruent trials in a random order. Include 400 trials total (320 congruent and 80 incongruent).
  5. Frame one should remain present in each trial for 100 ms, frame 2 for 100 ms, and frame three should remain present until a response is recorded.
  6. Finally, be sure to program the experiment to collect relevant data. The output file should have a header like that shown in the table in Figure 2, with each row including the data from one trial: the trial number, the position of the letter that appeared (left or right), the specific letter that appeared (L or T), whether the trial was congruent or incongruent (called the condition), the keypress made by the participant, and importantly, the reaction time-the time it took for the participant to make a keypress, measured from the onset of the letter. (This number should be recorded in ms, and expected to range between 50 and 500).

Figure 2
Figure 2. Sample table for organizing data output in a spatial cueing experiment. The primary measure of interest is the reaction time on each trial. In addition, the condition needs to be recorded in order to compare reaction time in congruent and incongruent trials, and the letter type and response given are necessary in order to evaluate response accuracy. It is also a good idea to record letter position to ensure that trials appear in the correct proportions. Please click here to view a larger version of this figure.

3. Running the Experiment

  1. To run the experiment, recruit 10 to 20 participants.
  2. When a participant arrives in the lab, explain that the experiment they will do is designed to investigate the nature of visual attention, and ask them to complete an informed consent agreement.
  3. Seat the participant in front of your testing computer, with the back of their chair 60 cm away from the monitor.
  4. Explain the instructions to them in detail:
    1. "Each trial of this experiment will be more or less the same. You will see a red fixation cross at the beginning of each trial. It is important that you keep your eyes fixated at that position at all times. After 100 ms, the fixation cross will be replaced by a red arrow pointing at one of the two green boxes that will also be in the display. Finally, after 100 ms, the arrow will disappear and a letter will appear in one of the two boxes. It will always be an L or a T, and your job is to report which one it is using the appropriate key. We want you to make a keypress as quickly as possible, without sacrificing accuracy, so it is a good idea to keep your right index finger on the L key and your left index finger on the T key at all times. After you make a response, there will be a half-second delay before the next trial begins. Note that the red arrow will not always point to the place where the letter will eventually appear. You will do 400 trials of the experiment, which should take only about 5 to 10 minutes. There will be a short break of two minutes when you are halfway through. Do you have any questions?"
  5. Once you answer any questions, start the program, and observe the participant for a few trials to make sure they understood the instructions. Then you can leave the testing room until the experiment is complete.

4. Analyzing the Results

  1. Your program should automatically populate the cells in your results table for each participant as the experiment progresses. Thus at the end of the experiment, you will have a table with 400 rows representing 400 trials for each participant.
  2. First, check that the responses provided are accurate. To do this, add a column to the table called Accuracy. Figure 3 shows a populated data table.
    1. To determine whether the response given was correct, compare responses given with the actual identities of the letters shown. Recall that the table includes a column for each of these.
      1. Excel (or other software) is able to automatically determine whether responses are correct by inputting the following formula into the new column called Accuracy:
        =if("Letter Type"= "Response Given",1,0)This means that if the character in the Letter Type column is the same as the one in the Response Given column, there will be a 1 in the accuracy column. Otherwise, there will be a 0, indicating an incorrect response.
      2. Compute average accuracy for each participant by averaging together the values in the new Accuracy column. If the proportion of correct responses for a participant is less than 0.8, do not further analyze the participant's results; this suggests that the participant either misunderstood the instructions, or did not place priority on performing accurately.
    2. Now the measure of interest can be computed. Average together the reaction time for a participant in all the congruent trials, and separately, in all the incongruent trials. Then compute a congruent and incongruent average for all the participants grouped together.

Figure 3
Figure 3. A data table populated with results from 25 spatial cueing trials. The final column, labelled 'Accuracy,' was added after the experiment was completed, and a formula was used to automate an accuracy check. Please click here to view a larger version of this figure.

Our ability to select certain information in an environment to process, while ignoring other stimuli, is referred to as attention.

Visual attention can either be overt—where the eyes are consciously aimed towards an object, like a rising full moon—or covert, in which a person notices something that they are not looking at directly.

For example, an individual might be staring at a sign pointing towards the left side of a fork in the road. However, they will still discern a nearby owl further down that path, because that’s the direction they are cued to go. This concept is referred to as spatial cueing—where covert attention is shifted by a particular signal.

Based on previous work by psychologist Michael Posner, this video demonstrates how to execute a computerized spatial cueing task, including how to interpret data investigating a measure of covert visual attention—reaction times across congruent and incongruent trials.

In this experiment, participants must detect and report brief visual targets that showcase focus and subsequent shifts in attention.

During every trial, participants are asked to observe three frames that occur in order: In frame 1, a red fixation cross, made of ½-in. long lines, is located in the center of the display. Two green boxes, each 1 by 1 in., are centered vertically, 1.5 in. away from the edges of the display.

After 100 ms, the second frame appears for this same duration, but this time, the fixation cross is replaced with a cue—a red arrow that points towards one of the two green boxes.

In the third frame, the cue arrow is simultaneously replaced with the fixation cross. In half of the trials, the letter 'T' is added to one of the two boxes, whereas the other half contains the letter 'L'; both are equally distributed. Participants are asked to identify the letter shown.

Following every response, a brief 500-ms inter-trial-interval occurs, and the sequence is repeated for a total of 400 trials.

Here, the trick is that they are either congruent, where the letter appears in the box that the arrow is pointing to 80% of the time, or incongruent, where it appears opposite of the arrow’s direction for 20% of the trials.

The dependent variable is then the time it takes a participant to make a correct response across trial types, which is achieved by simply choosing the letter shown in the box, regardless of the side.

Participants are expected, on average, to be faster at responding during congruent trials compared to incongruent ones, thus showing the advantages associated with cueing the spatial location of where one should focus their attention.

In preparation for the experiment, open the software program and verify that the spatial cueing paradigm is working correctly.

After recruiting participants, bring each one into the lab and explain that the task is designed to investigate the nature of visual attention. Before proceeding, ask them to complete an informed consent form.

To begin, seat the participant in front of the testing computer, with the back of their chair 60 cm away from the monitor. Explain the task instructions and answer any questions.

When the participant is ready, allow them to start the program by pressing the spacebar. Observe them over a few trials to ensure that they are either pressing the key 'L' or 'T' as soon as the letter appears on the screen.

Leave the testing room as they complete the 400 trials. Halfway through the experiment, provide a 2-min break, making the total task time less than 10 min.

To begin data analysis, first retrieve the captured data that were initially programmed into an output file.

Note that data for the following items should automatically be populated into the table: the trial number, the letter position, the letter type, the condition, the actual response given by the participant, and importantly, the reaction time—measured from the onset of the letter to the keypress.

Next, check whether the responses provided are accurate by adding a column called 'Accuracy' to the table. To populate this column, create a formula to compare 'Letter Type' with the 'Response Given', such that a 1 represents a correct response and 0 indicates an incorrect answer.

Now, verify that the total averaged accuracy values for each participant are above 0.8 to ensure that participants understood the task instructions.

To visualize the data, graph the average reaction times across participants by trial type. Note that they responded about 200 ms faster in congruent compared to incongruent trials.

This difference suggests that the arrow cued participants to attend to a particular spatial location, allowing them to more quickly process and identify the letter when it appeared there.

Now that you are familiar with designing an experiment to examine spatial cueing, let’s examine how researchers have used variations of the paradigm to investigate how attentional ability changes in cases of brain injury along with alterations in task demands.

Studies using functional magnetic resonance imaging indicated that regions within the parietal lobe are involved in the ability to orient attention to a spatial location.

In patients with focal damage due to strokes or tumors, Posner and colleagues discovered that reaction times were longer during incongruent compared to congruent trials and notably, when compared to neurological controls—those with lesions outside of the parietal area—which confirm the functional significance of this region.

Also, as you’ve learned already, the inclusion of cues in the task leads to anticipatory thoughts of where to focus attention, even though those expectations might not be met.

Researchers have adapted the paradigm to identify the kinds of stimuli, like unexpected bright flashes, that may automatically cause attention to shift. Such modifications could benefit individuals that may have trouble focusing under constrained demands, like those with Attention-Deficit-Hyperactivity Disorder.

You’ve just watched JoVE’s introduction to spatial cueing. Now you should have a good understanding of how to design and conduct a covert visual attention paradigm as well as how to analyze and interpret attentional demands when cues are both expected and mismatched.

Thanks for watching!

Results

Figure 4 shows average reaction time for a group of participants, comparing congruent and incongruent trials. Participants were, on average, about 200 ms faster to respond in congruent trials. This shows the advantages associated with the location where one attends and the costs to other locations. The arrow gave participants 80% reliable information about where the letter would appear in each trial, so participants directed visual attention to the positions pointed to by the arrow. When the letter then appeared in that position, which it did most of the time, the participants could process and identify it quickly. When the letter appeared opposite though, participants needed to shift their attention across the screen in order to then process and identify the letter presented, a shift of attention that seemed to have taken about 200 ms, on average.

Figure 4
Figure 4. Reaction time results of a spatial cueing experiment. Participants generally responded more quickly in congruent compared to incongruent trials. In congruent trials, the cue arrow pointed to the place where a letter eventually appeared. But in incongruent trials, it pointed opposite. The difference in reaction times suggests that the arrow led participants to attend to the box pointed to by the arrow, allowing them to more quickly process and identify the letter when it appeared there.

Applications and Summary

Since it was introduced in the late 1970s, the spatial-cueing task has been used widely by researchers, for example, in order to identify the kinds of stimuli that might automatically cause attention to shift. For example, researchers have investigated whether bright flashes and loud sounds automatically cause attention to shift. In these experiments the letters that need to be identified are sometimes preceded by unexpected lights and sounds. Researchers can then compare detection speeds when a bright flash, for instance, precedes a letter in the same position or in a different position. A cost associated with a flash in an opposite position implies that the flash automatically captured attention.

In the 1990s and after, the task became an important one for use in conjunction with functional magnetic resonance imaging in order to identify the neurological centers involved in the control of spatial attention. By contrasting brain activity in congruent and incongruent conditions, researchers have discovered that regions of the parietal lobe are involved in the additional attentional shift that takes place in incongruent trials compared to congruent ones.

References

  1. Posner, M. I. (1980). Orienting of attention. Quarterly journal of experimental psychology, 32(1), 3-25.
  2. Posner, M. I., Snyder, C. R., & Davidson, B. J. (1980). Attention and the detection of signals. Journal of experimental psychology: General, 109(2), 160.

1. Equipment

  1. The experiment requires a computer and experiment implementation software such as E-Prime, or a programming environment such as MATLAB or PsychoPy.

2. Stimulus and Experiment Design

  1. The experiment involves short trials in which participants must detect and report a brief visual target. Each trial comprises three frames. Figure 1 depicts the frames.

Figure 1
Figure 1. Sequence of events in the spatial cueing paradigm used to measure the consequences of visual attention. Each trial begins the same way, as shown in frame one, with a central fixation cross and two green boxes on either side. In frame two, the fixation cross is replaced by an arrow, pointing to one of the two boxes (50% of the time each). Finally, in frame three a letter is shown-either an L or a T-in one of the two boxes. In the example shown, the letter is an L. In the right panel example, the letter appears in the box that the arrow points to, producing a congruent trial. In the panel on the left, the letter appears opposite the arrow, producing an incongruent trial. The measure of interest is the time it takes a participant to make a correct response (the reaction time), in particular, the average difference between congruent and incongruent trials.

  1. In frame one, there are two green boxes, 1.0 in. x 1.0 in. on either side of the display, centered vertically. In addition, there is a red fixation cross made of 0.5 in. long lines, located exactly in the center of the display. The green boxes should be about 1.5 in. away from the edges of the display.
  2. In the second frame, the fixation cross is replaced by a cue, an arrow that points at one of the two green boxes. Make the arrow red, and easy to see, as shown in Figure 1.
  3. In frame three, a 'T' or 'L' is added to one of the two boxes, and the arrow from frame two is replaced by the reappearance of the fixation cross.
    1. The participant's task is to indicate whether the letter in the box is an 'L' or a 'T' using the appropriate keys. Each letter will appear 50% of the time.
    2. In 80% of the trials, the letter appears in the box that the arrow points to in frame two. These are called congruent trials. In the remaining 20% of trials, the letter appears opposite the arrow's direction. These are called incongruent trials.
    3. Overall, the letters will appear equally often on the right or left.
  4. Sequence the experiment, just as described, to include the correct proportions of congruent and incongruent trials in a random order. Include 400 trials total (320 congruent and 80 incongruent).
  5. Frame one should remain present in each trial for 100 ms, frame 2 for 100 ms, and frame three should remain present until a response is recorded.
  6. Finally, be sure to program the experiment to collect relevant data. The output file should have a header like that shown in the table in Figure 2, with each row including the data from one trial: the trial number, the position of the letter that appeared (left or right), the specific letter that appeared (L or T), whether the trial was congruent or incongruent (called the condition), the keypress made by the participant, and importantly, the reaction time-the time it took for the participant to make a keypress, measured from the onset of the letter. (This number should be recorded in ms, and expected to range between 50 and 500).

Figure 2
Figure 2. Sample table for organizing data output in a spatial cueing experiment. The primary measure of interest is the reaction time on each trial. In addition, the condition needs to be recorded in order to compare reaction time in congruent and incongruent trials, and the letter type and response given are necessary in order to evaluate response accuracy. It is also a good idea to record letter position to ensure that trials appear in the correct proportions. Please click here to view a larger version of this figure.

3. Running the Experiment

  1. To run the experiment, recruit 10 to 20 participants.
  2. When a participant arrives in the lab, explain that the experiment they will do is designed to investigate the nature of visual attention, and ask them to complete an informed consent agreement.
  3. Seat the participant in front of your testing computer, with the back of their chair 60 cm away from the monitor.
  4. Explain the instructions to them in detail:
    1. "Each trial of this experiment will be more or less the same. You will see a red fixation cross at the beginning of each trial. It is important that you keep your eyes fixated at that position at all times. After 100 ms, the fixation cross will be replaced by a red arrow pointing at one of the two green boxes that will also be in the display. Finally, after 100 ms, the arrow will disappear and a letter will appear in one of the two boxes. It will always be an L or a T, and your job is to report which one it is using the appropriate key. We want you to make a keypress as quickly as possible, without sacrificing accuracy, so it is a good idea to keep your right index finger on the L key and your left index finger on the T key at all times. After you make a response, there will be a half-second delay before the next trial begins. Note that the red arrow will not always point to the place where the letter will eventually appear. You will do 400 trials of the experiment, which should take only about 5 to 10 minutes. There will be a short break of two minutes when you are halfway through. Do you have any questions?"
  5. Once you answer any questions, start the program, and observe the participant for a few trials to make sure they understood the instructions. Then you can leave the testing room until the experiment is complete.

4. Analyzing the Results

  1. Your program should automatically populate the cells in your results table for each participant as the experiment progresses. Thus at the end of the experiment, you will have a table with 400 rows representing 400 trials for each participant.
  2. First, check that the responses provided are accurate. To do this, add a column to the table called Accuracy. Figure 3 shows a populated data table.
    1. To determine whether the response given was correct, compare responses given with the actual identities of the letters shown. Recall that the table includes a column for each of these.
      1. Excel (or other software) is able to automatically determine whether responses are correct by inputting the following formula into the new column called Accuracy:
        =if("Letter Type"= "Response Given",1,0)This means that if the character in the Letter Type column is the same as the one in the Response Given column, there will be a 1 in the accuracy column. Otherwise, there will be a 0, indicating an incorrect response.
      2. Compute average accuracy for each participant by averaging together the values in the new Accuracy column. If the proportion of correct responses for a participant is less than 0.8, do not further analyze the participant's results; this suggests that the participant either misunderstood the instructions, or did not place priority on performing accurately.
    2. Now the measure of interest can be computed. Average together the reaction time for a participant in all the congruent trials, and separately, in all the incongruent trials. Then compute a congruent and incongruent average for all the participants grouped together.

Figure 3
Figure 3. A data table populated with results from 25 spatial cueing trials. The final column, labelled 'Accuracy,' was added after the experiment was completed, and a formula was used to automate an accuracy check. Please click here to view a larger version of this figure.

Our ability to select certain information in an environment to process, while ignoring other stimuli, is referred to as attention.

Visual attention can either be overt—where the eyes are consciously aimed towards an object, like a rising full moon—or covert, in which a person notices something that they are not looking at directly.

For example, an individual might be staring at a sign pointing towards the left side of a fork in the road. However, they will still discern a nearby owl further down that path, because that’s the direction they are cued to go. This concept is referred to as spatial cueing—where covert attention is shifted by a particular signal.

Based on previous work by psychologist Michael Posner, this video demonstrates how to execute a computerized spatial cueing task, including how to interpret data investigating a measure of covert visual attention—reaction times across congruent and incongruent trials.

In this experiment, participants must detect and report brief visual targets that showcase focus and subsequent shifts in attention.

During every trial, participants are asked to observe three frames that occur in order: In frame 1, a red fixation cross, made of ½-in. long lines, is located in the center of the display. Two green boxes, each 1 by 1 in., are centered vertically, 1.5 in. away from the edges of the display.

After 100 ms, the second frame appears for this same duration, but this time, the fixation cross is replaced with a cue—a red arrow that points towards one of the two green boxes.

In the third frame, the cue arrow is simultaneously replaced with the fixation cross. In half of the trials, the letter 'T' is added to one of the two boxes, whereas the other half contains the letter 'L'; both are equally distributed. Participants are asked to identify the letter shown.

Following every response, a brief 500-ms inter-trial-interval occurs, and the sequence is repeated for a total of 400 trials.

Here, the trick is that they are either congruent, where the letter appears in the box that the arrow is pointing to 80% of the time, or incongruent, where it appears opposite of the arrow’s direction for 20% of the trials.

The dependent variable is then the time it takes a participant to make a correct response across trial types, which is achieved by simply choosing the letter shown in the box, regardless of the side.

Participants are expected, on average, to be faster at responding during congruent trials compared to incongruent ones, thus showing the advantages associated with cueing the spatial location of where one should focus their attention.

In preparation for the experiment, open the software program and verify that the spatial cueing paradigm is working correctly.

After recruiting participants, bring each one into the lab and explain that the task is designed to investigate the nature of visual attention. Before proceeding, ask them to complete an informed consent form.

To begin, seat the participant in front of the testing computer, with the back of their chair 60 cm away from the monitor. Explain the task instructions and answer any questions.

When the participant is ready, allow them to start the program by pressing the spacebar. Observe them over a few trials to ensure that they are either pressing the key 'L' or 'T' as soon as the letter appears on the screen.

Leave the testing room as they complete the 400 trials. Halfway through the experiment, provide a 2-min break, making the total task time less than 10 min.

To begin data analysis, first retrieve the captured data that were initially programmed into an output file.

Note that data for the following items should automatically be populated into the table: the trial number, the letter position, the letter type, the condition, the actual response given by the participant, and importantly, the reaction time—measured from the onset of the letter to the keypress.

Next, check whether the responses provided are accurate by adding a column called 'Accuracy' to the table. To populate this column, create a formula to compare 'Letter Type' with the 'Response Given', such that a 1 represents a correct response and 0 indicates an incorrect answer.

Now, verify that the total averaged accuracy values for each participant are above 0.8 to ensure that participants understood the task instructions.

To visualize the data, graph the average reaction times across participants by trial type. Note that they responded about 200 ms faster in congruent compared to incongruent trials.

This difference suggests that the arrow cued participants to attend to a particular spatial location, allowing them to more quickly process and identify the letter when it appeared there.

Now that you are familiar with designing an experiment to examine spatial cueing, let’s examine how researchers have used variations of the paradigm to investigate how attentional ability changes in cases of brain injury along with alterations in task demands.

Studies using functional magnetic resonance imaging indicated that regions within the parietal lobe are involved in the ability to orient attention to a spatial location.

In patients with focal damage due to strokes or tumors, Posner and colleagues discovered that reaction times were longer during incongruent compared to congruent trials and notably, when compared to neurological controls—those with lesions outside of the parietal area—which confirm the functional significance of this region.

Also, as you’ve learned already, the inclusion of cues in the task leads to anticipatory thoughts of where to focus attention, even though those expectations might not be met.

Researchers have adapted the paradigm to identify the kinds of stimuli, like unexpected bright flashes, that may automatically cause attention to shift. Such modifications could benefit individuals that may have trouble focusing under constrained demands, like those with Attention-Deficit-Hyperactivity Disorder.

You’ve just watched JoVE’s introduction to spatial cueing. Now you should have a good understanding of how to design and conduct a covert visual attention paradigm as well as how to analyze and interpret attentional demands when cues are both expected and mismatched.

Thanks for watching!

A subscription to JoVE is required to view this article.
You will only be able to see the first 20 seconds.

RECOMMEND JoVE