A subscription to JoVE is required to view this content. Sign in or start your free trial.

Method Article

Post-Movie Subliminal Measurement (PMSM), for Investigating Implicit Social Bias

5.6K views

⸱

DOI:

10.3791/60817

⸱

February 29th, 2020

 , 
1Department of Neuroscience and Biomedical Engineering, Aalto University, 2Advanced Magnetic Imaging (AMI) Centre, Aalto NeuroImaging, Aalto University, 3Department of Media, School of Arts Design and Architecture, Aalto University, 4International Laboratory for Social Neuroscience, Institute of Cognitive Neuroscience, National Research University Higher School of Economics, 5Department of Film and Media, Stockholm University of the Arts

In This Article

Summary

This protocol describes the use of movies to investigate brain mechanisms underlying implicit social biases during functional magnetic resonance imaging. When the face of a protagonist is presented after a movie subliminally, it evokes an implicit response based on knowledge of the protagonist gained during the movie.

Abstract

New knowledge is continuously gained from a social environment that can influence how people respond to each other. Such responses often occur implicitly, at a subliminal perceptual level, and related brain mechanisms can be experimentally isolated by presenting the stimuli quickly. Subliminal presentation of faces that belong to different ethnicity groups, races, or gender has been shown to be successful in investigating social implicit responses. However, many implicit responses are based on knowledge previously gained about the faces (e.g., sexual orientation, political views, and socioeconomic status) and not solely on physical appearance. Here, a novel method called post-movie subliminal measurement (PMSM) is presented. When watching a socially engaging movie, a spectator gains knowledge about the protagonist and becomes familiar with his/her identity and world views. When the face of the protagonist is presented subliminally after the movie, it evokes an implicit neural response depending on what is learned about the protagonist. With a vast number of movies available, each depicting a variety of people with different identities, the PMSM method enables investigation of the brain's complex implicit biases in a manner that resembles real-life social perceptions.

Introduction

Recent studies show that initial social judgment becomes formulated within the first 32–100 ms of meeting another person1,2,3,4,5,6,7. Subliminal presentation of faces has been used extensively to investigate implicit biases towards different ethnic and racial groups (e.g., by presenting Caucasian American and African American faces that differ in skin color to subjects from both groups)8,9,10,11,12,13,14. However, social groups are also characterized by factors other than physical facial characteristics15.

Facial perception has been shown to be highly sensitive to contextual cues (i.e., body posture16, eye-gaze direction of the face17, a priori knowledge about the face18, visual background of the presented face19, presentation of the face separately or with other faces20). These factors can all affect facial perception. Weiser and Brosch21, in their extensive review, suggested to investigate facial perception in more naturalistic settings by ensuring that laboratory experiment is similar to real-life environments. Indeed, even simple tasks, such as recognizing people, have been shown to be more accurate when presented with video footage closer to real-life perception than when using static images22.

During the last several decades, brain imaging studies have proven that video clips can be successfully used to study realistic social perception23,24,25,26,27,28,29. The presented method is based on results from these studies and additional findings demonstrating that movie narratives can temporarily transport viewers to the world of a protagonist30. The protocol combines movie viewing with subliminal stimulus presentation as an alternative method to investigate implicit social bias formation under naturalistic conditions.

The protocol for this novel approach, post-movie subliminal measurement (PMSM), is presented here. When watching a socially engaging movie, the spectator gains knowledge about the protagonist and becomes familiar with his/her identity and world views. In contrast with other narrative art forms, movies are unique in that they present a compelling, rich, and complex story over a short time period. Furthermore, audiovisual and cinematic properties of movies synchronize brain activity across spectators23,25,29,31. Thus, it is helpful to ensure that subjects are presented with the information in a considerably similar way.

The PMSM method shows that when the face of a protagonist is presented subliminally after the movie (vs. before), implicit neural responses are successfully evoked. These responses depend on knowledge that the viewer gains about the protagonist's character with respect to his/her implicit social views. As there is a vast number of movies available that depict a variety of social characters, the PMSM method enables investigation of the brain's complex implicit views in a manner that is close to real-life social perceptions.

Access restricted. Please log in or start a trial to view this content.

Protocol

The protocol was approved by the Aalto University Research Ethics Committee.

1. Participant screening and preparation

  1. Match the different groups of recruited participants (here, heterosexual and homosexual groups) according to age, handedness, and level of education. Ensure that all participants can fully comprehend the language of the movie and feel comfortable watching it without subtitles. Alternatively, consider screening a movie in the native tongue of participants.
    1. Exclude participants who have seen the planned movie within the past couple of years, as this can affect baseline measurements. Ideally, recruit participants who have not seen the movie previously. Do this by asking participants to indicate, from a list of movie titles (including the name of the move to be used in addition to 20 other movie titles), which movies they have seen in the past couple of years.
  2. Follow the specific institution's ethical guidelines for non-medical experiments with healthy participants under no psychiatric medication and no current neurological disease diagnosis. Recruit participants with normal or corrected vision for the fMRI scan. Recruit non-smokers and people that are comfortable with not moving for the duration of the experiment to avoid corruption of fMRI data due to unnecessary head motion.
  3. Scan all participants at a similar time of the day, preferably morning or early evening (9:00 A.M. to 5:00 P.M.), with no excessive consumption of coffee or food directly prior to scanning.
  4. Perform blinded recruitment to assure that participant responses are genuine and not emotionally regulated. Do not inform participants of the aim of the experiment (e.g., investigating implicit bias among homosexual and heterosexual subjects). For example, tell participants that the experiment is about movie viewing and that the real aim of the study will be explained only after the experiment. Exclude participants who know the aim of the study in advance.
  5. Perform a behavioral measurement such as the Implicit Association Task IAT32 to assure that the experimental groups have implicit biases. Use the measurement to assure that the groups do show biases, as strengths of implicit biases differ. Use IAT after the scan to prevent the participants from guessing the goal of the experiment.

2. Procedure outside MRI

  1. Upon arrival, brief participants with stages of the experiment, risks, and use of their experiment data. Conclude the briefing by asking if they have any questions regarding the experiment and that further explanation will be provided afterwards. Ask participants to read the briefing of the experiment and sign the consent form.
  2. Ask participants to remove all metal objects from their clothing or (preferably) change to a metal-free lab cloth to ensure safe access to the fMRI magnet. Scan participants using a metal detection device to assure that no metal was left behind (i.e., watch, belt, etc.). Standard contraindications to MRI should be respected33.
  3. Ask participants to enter the fMRI laboratory for configuration of the video projector and audio system. Instruct participants to lay down on the fMRI bed. Play a sample video to ensure that the picture is easily visible and audio level is comfortable and clear. If any complaints are made, adjustments should be made accordingly. Ensure that the headphones are presenting sound correctly.
  4. Connect the fMRI-compatible eye-tracking system. Tracking is used to ensure that subjects are attentive during the experiment and do not fall asleep or daydream during the scan. The eye-tracking is for data quality assurance only. Once tracking is secured, start the calibration process to begin recording eye movements.
  5. Inform subjects that the experiment is about to begin and that the scanning time will take 30 min to complete. Instruct participants to 1) relax as if they are watching a TV program in their home and 2) follow the instruction slides that will guide them through the different steps during the scan. Start the fMRI scan.
  6. Once the scanning is done, move participants to a different room, in which additional behavioral measurements will be collected (i.e., how much they identified with the character in different parts of the movie, IAT measurements to assess implicitly biases).
  7. Once all data are collected, debrief participants regarding the real goal of the experiment and answer any additional questions.

3. Procedure inside MRI

NOTE: During the fMRI session, participants are presented with a 30 min audiovisual content, which includes instruction slides, 4 min pre-movie subliminal measurement (for baseline), a 20 min movie, 4 min post-movie subliminal measurement, and concluding slides. In this section, follow the protocol to become familiar with the steps needed to create different parts of the stimuli as well as the order of presentation. Since the flash of the face during the subliminal portion has a 40 ms duration (a duration of a one video frame), it is possible to use an off-the-shelf video editing program (e.g., AVID media composer software or Adobe Premiere Pro editing software) to create the subliminal stimuli as well as edit the movie, if needed. When presenting the stimuli in the correct order using locked timing, use a software that is compatible with fMRI stimuli presentation (e.g., Presentation software, Neurobehavioral Systems Inc., Albany, California, USA).

  1. The 4 min periods of subliminal measurements (baseline and post-movie) are identical. Do not inform participants of their nature or purpose at this stage, and present them during the beginning of the scan with the following instruction slide:
    "Soon you will see a calibration clip. This clip is meant for calibrating the MRI scanner for your responses. The clip is only four min long and will look like white noise on a TV screen. Please keep your eyes fixated at the mark in the center of the screen until notified otherwise".
    NOTE: The 4 min stimuli period contains white noise, virtually divided into 16 blocks of 15 s each. The 16 blocks of white noise contain two types of blocks: a rest block (white nose without subliminal flashes) followed by a condition block (white noise with flashes of the protagonist face). See Figure 1 for an illustration of the stimulus structure.
  2. To create the 4 min subliminal stimuli, start with a 15 s white noise clip. The white noise serves as a masking stimulus for the face that is being flashed. Since the brain is sensitive to face presentation, it is important to use good masking, even if the face is presented subliminally. Therefore, use a dynamic white noise clip that has large distortion and movements in difference of a homogeneous white noise (e.g., with small random white and black dots).
    1. Create the 15 s condition block by inserting the 10 flashes of the protagonist's face into the dynamic white noise. The subliminal flashes should occur in 40 ms durations, starting at the onset of the condition block inserted every 1,500 ms.
    2. The face of the protagonist should be facing the camera with neutral face expression. If possible, take a frame from the movie (a close-up of the character in the movie) or search for an image of the actor/actress from the internet. Ensure that the actor/actress appears similar to his/her appearance in the movie (e.g., no significant differences in features such hair or beard or accessories). Make sure the face has a neutral face expression and is clear and well-lit.
    3. Adjust the image by centering it in the middle of the screen. Avoid using an image with a small size face and with bad resolution. Make sure there are no salient objects in the background of the face, such as other people, text, or identifiable visuals. If there are, cut them out or mask them to create a neutral image. Flip the image from color to black-and-white before inserting.
    4. Once the white noise rest-block and the condition block (with the face flashes) are ready, duplicate them to create the 4 min subliminal stimuli, ordering the blocks one after the other starting with the rest-block. By the end of the process, one should have 4 min containing 16 blocks each of 15 s (eight rest blocks and eight condition blocks).
    5. Add a fixation mark in the middle of the screen of the 4 min subliminal measurement. Make sure it is easily noticeable. Add a 2 s fixation mark before the 4 min clip to make it easy for participants to find and start the task.
  3. At the end of the baseline (the 4 min pre-movie subliminal measurement), insert a text slide indicating the beginning of the movie, length of the movie, and reminder to the to be relaxed and freely watch the movie. For example:
    "Thank you. The calibration was done successfully! You are now about to watch a 20 min movie. Try to relax and to enjoy the story."
  4. Choose a movie that is emotional, engaging, and character-driven (i.e., has a clear protagonist with a strong conflict). For example, a previous experiment regarding social bias was conducted on homosexual and heterosexual subjects to whom a movie about a homosexual priest was presented. The story was about a priest who struggles between his wish to serve his beliefs as a catholic priest and his desire to be loved by another man.
    NOTE: The film can be documentary or fiction. It can be a short film or stand-alone episode from a TV series. It is important that the movie has a clear story with a beginning, middle, and end that can be easily understood and followed. It is also possible to edit a shorter version from a longer film. For example, our stimuli from the homosexual/heterosexual experiment was a 20 min version story edited by a professional filmmaker (the first author) from a longer film titled Priest (directed by Antonia Bird, 1994). The more relevant to the subject group a movie is, the more engaging the viewing will be.
  5. After the movie, the 4 min subliminal measurement for PMSM should be repeated to observe how implicit neural responses to the protagonist's face are biased after watching the movie (vs. before). To indicate this, insert the following slide:
    "Thank you! We are almost done. Before finishing the measurement, we need to recalibrate our MRI device to your response. The clip is only four minutes long and will look like white noise on a TV screen. Please keep your eyes fixated at the mark in the center of the screen until notified otherwise"
  6. Finally, present the 4 min PMSM (the same 4 min used to perform the pre-movie baseline measurement).

Access restricted. Please log in or start a trial to view this content.

Results

Presented here are some results using PMSM from the published article by Afdile et al.34. Here, implicit bias was investigated among homosexual and heterosexual subjects (15 heterosexuals, 14 homosexuals) toward the protagonist after realizing he is homosexual in the movie, making him an "ingroup" to the homosexual participants and "outgroup" to the heterosexual participants. In line with our IAT results, this factor was shown to be significant in both groups, in which the heterosexual subjects we...

Access restricted. Please log in or start a trial to view this content.

Discussion

This paper outlines the novel method for investigating the implicit brain using a post-movie subliminal measurement referred to as PMSM. In a recently published study, this method has shown that 1) implicit brain response is dynamic and 2) there is continuous learning from the social environment as well as formulation of judgment based on contextual knowledge (and not solely based on facial characteristics). Therefore, the proposed PMSM method can provide an alternative to the classical method when investigating implicit...

Access restricted. Please log in or start a trial to view this content.

Disclosures

The authors have nothing to disclose.

Acknowledgements

This work was supported by Academy of Finland, grant numbers [259952, 276643]. We would like to thank Mikko Sams for the supervision and Enrico Glerean, Jussi Alho, Anna Äimälä for helping with the data, Johan Westö for helping with the visualization as well as Marita Kattelus and Toni Auranen from Advanced Magnetic Imaging (AMI) Centre, Aalto NeuroImaging, Aalto University, Espoo, Finland for their help and support.

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
3T Siemens MAGNETOM SkyraSiemens Healthcare, Erlangen, GermanyMRI device, using a standard 20-channel receiving head-neck coil
Avid Media Composerhttps://www.avid.com/media-composerVideo editing software used to create the stimuli.
EAR-tipEtymotic Research, ER3, IL, USAEarplugs compatible for MRI
FSL softwarehttps://www.win.ox.ac.uk/, version 5.0.9Software used to analyse the data.
Panasonic PT-DZ110X projectorPanasonic Corporation, Osaka, JapanThe stimuli were back-projected on a semitransparent screen
Presentation softwareNeurobehavioral Systems Inc., Albany, California, USASoftware used to present stimuli during the fMRI scan
Sensimetrics S14 insert earphonesSensimetrics Corporation, Malden, Massachusetts, USAAuditory stimulation was delivered through Sensimetrics S14 insert earphones

References

  1. Bar, M., Neta, M., Linz, H. Very first impressions. Emotion. 6 (2), 269-278 (2006).
  2. Ballew, C. C., Todorov, A. Predicting political elections from rapid and unreflective face judgments. Proceedings of the National Academy of Sciences of the United States of America. 104 (46), 17948-17953 (2007).
  3. Porter, S., England, L., Juodis, M., ten Brinke, L., Wilson, K. Is the face a window to the soul? Investigation of the accuracy of intuitive judgments of the trustworthiness of human faces. Canadian Journal of Behavioural Science. 40 (3), 171-177 (2008).
  4. Borkenau, P., Brecke, S., Möttig, C., Paelecke, M. Extraversion is accurately perceived after a 50-ms exposure to a face. Journal of Research in Personality. 43 (4), 703-706 (2009).
  5. Rule, N. O., Ambady, N. She's Got the Look: Inferences from Female Chief Executive Officers' Faces Predict their Success. Sex Roles. 61 (9-10), 644-652 (2009).
  6. Todorov, A., Pakrashi, M., Oosterhof, N. N. Evaluating Faces on Trustworthiness After Minimal Time Exposure. Social Cognition. 27 (6), 813-833 (2009).
  7. Todorov, A., Loehr, V., Oosterhof, N. N. The Obligatory Nature of Holistic Processing of Faces in Social Judgments. Perception. 39 (4), 514-532 (2010).
  8. Hart, A. J., et al. Differential response in the human amygdala to racial outgroup vs ingroup face stimuli. Neuroreport. 11 (11), 2351-2355 (2000).
  9. Phelps, E. A., et al. Performance on Indirect Measures of Race Evaluation Predicts Amygdala Activation. Journal of Cognitive Neuroscience. 12 (5), 729-738 (2000).
  10. Cunningham, W. A., et al. Separable Neural Components in the Processing of Black and White Faces. Psychological Science. 15 (12), 806-813 (2004).
  11. Avenanti, A., Sirigu, A., Aglioti, S. M. Racial Bias Reduces Empathic Sensorimotor Resonance with Other-Race Pain. Current Biology. 20 (11), 1018-1022 (2010).
  12. Kubota, J. T., Banaji, M. R., Phelps, E. A. The neuroscience of race. Nature Neuroscience. 15 (7), 940-948 (2012).
  13. Freeman, J. B., Johnson, K. L. More Than Meets the Eye: Split-S Social Perception. Trends in Cognitive Sciences. 20 (5), 362-374 (2016).
  14. Bagnis, A., Celeghin, A., Mosso, C. O., Tamietto, M. Toward an integrative science of social vision in intergroup bias. Neuroscience and Biobehavioral Reviews. 102, 318-326 (2019).
  15. Brown, R., Hewstone, M. An integrative theory of intergroup contact. The Social Psychology of Intergroup Relations. , 255-343 (2005).
  16. Meeren, H. K. M., van Heijnsbergen, C. C. R. J., de Gelder, B. Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences of the United States of America. 102 (45), 16518-16523 (2005).
  17. Ewbank, M. P., Fox, E., Calder, A. J. The interaction between gaze and facial expression in the amygdala and extended amygdala is modulated by anxiety. Frontiers in Human Neuroscience. 4, 56(2010).
  18. Schwarz, K. A., Wieser, M. J., Gerdes, A. B. M., Mühlberger, A., Pauli, P. Why are you looking like that? How the context influences evaluation and processing of human faces. Social Cognitive and Affective Neuroscience. 8 (4), 438-445 (2013).
  19. Righart, R., de Gelder, B. Recognition of facial expressions is influenced by emotional scene gist. Cognitive, Affective, and Behavioral Neuroscience. 8 (3), 264-272 (2008).
  20. Mumenthaler, C., Sander, D. Social appraisal influences recognition of emotions. Journal of Personality and Social Psychology. 102 (6), 1118-1135 (2012).
  21. Wieser, M. J., Brosch, T. Faces in context: A review and systematization of contextual influences on affective face processing. Frontiers in Psychology. 3, (2012).
  22. O'Toole, A. J., et al. Recognizing people from dynamic and static faces and bodies: Dissecting identity with a fusion approach. Vision Research. 51 (1), 74-83 (2011).
  23. Hasson, U. Intersubject Synchronization of Cortical Activity During Natural Vision. Science. 303 (5664), 1634-1640 (2004).
  24. Malinen, S., Hlushchuk, Y., Hari, R. Towards natural stimulation in fMRI-Issues of data analysis. NeuroImage. 35 (1), 131-139 (2007).
  25. Jääskeläinen, I. P., et al. Inter-Subject Synchronization of Prefrontal Cortex Hemodynamic Activity During Natural Viewing. The Open Neuroimaging Journal. 2 (1), 14-19 (2008).
  26. Wilson, S. M., Molnar-Szakacs, I., Iacoboni, M. Beyond superior temporal cortex: Intersubject correlations in narrative speech comprehension. Cerebral Cortex. 18 (1), 230-242 (2008).
  27. Lahnakoski, J. M., et al. Synchronous brain activity across individuals underlies shared psychological perspectives. NeuroImage. 100, 316-324 (2014).
  28. Saarimäki, H., et al. Discrete Neural Signatures of Basic Emotions. Cerebral Cortex. 26 (6), 2563-2573 (2016).
  29. Bacha-Trams, M., et al. Differential inter-subject correlation of brain activity when kinship is a variable in moral dilemma. Scientific Reports. 7 (1), 14244(2017).
  30. Hall, A. E., Bracken, C. C. I really liked that movie. Journal of Media Psychology. 23 (2), 90-99 (2011).
  31. Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., Heeger, D. J. Neurocinematics: The Neuroscience of Film. Projections. 2 (1), 1-26 (2008).
  32. Greenwald, A. G., McGhee, D. E., Schwartz, J. L. K. Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology. 74 (6), 1464-1480 (1998).
  33. MHRA Safety guidelines for MRI equipment in clinical use. 3, 104(2007).
  34. Afdile, M., et al. Contextual knowledge provided by a movie biases implicit perception of the protagonist. Social Cognitive and Affective Neuroscience. 14 (5), 519-527 (2019).
  35. Dal Cin, S., Zanna, M. P., Fong, G. T. Narrative persuasion and overcoming resistance BT - Resistance to persuasion. Resistance to persuasion. Knowles, E. S., Linn, J. A. , Lawrence Erlbaum Associates, Publishers. 175-191 (2004).
  36. Wheeler, S. C., Green, M. C., Brock, T. C. Fictional narratives change beliefs: Replications of Prentice, Gerrig, and Bailis (1997) with mixed corroboration. Psychonomic Bulletin and Review. 6 (1), 136-141 (1999).
  37. Green, M. C., Brock, T. C. The role of transportation in the persuasiveness of public narratives. Journal of Personality and Social Psychology. 79 (5), 701-721 (2000).
  38. Wang, J., Calder, B. J. Media Transportation and Advertising. Journal of Consumer Research. 33 (2), 151-162 (2006).
  39. Green, M. C. Transportation Into Narrative Worlds: The Role of Prior Knowledge and Perceived Realism. Discourse Processes. 38 (2), 247-266 (2004).
  40. Schulenberg, S. E. Psychotherapy and Movies: On Using Films in Clinical Practice. Journal of Contemporary Psychotherapy. 33 (1), 35-48 (2003).

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Tags

fMRI ScanSubliminal StimuliBaseline MeasurementEye Tracking SystemMovie ProtagonistTwo Way ANOVANeural ResponseSocial Perception
Post-Movie Subliminal Measurement (PMSM), for Investigating Implicit Social Bias
Contact Us
Recommend to Library

Privacy

Terms of Use

Policies

Copyright © 2026 MyJoVE Corporation. All rights reserved.