JoVE Science Education
Social Psychology
A subscription to JoVE is required to view this content.  Sign in or start your free trial.
JoVE Science Education Social Psychology
Evaluating the Accuracy of Snap Judgments
  • 00:00Overview
  • 01:07Experimental Design
  • 03:36Running the Experiment
  • 05:19Data Analysis and Results
  • 06:26Applications
  • 07:35Summary

הערכת הדיוק של פסקי דין מהירים

English

Share

Overview

מקור: דייגו ריינרו וג’יי ואן באבל – אוניברסיטת ניו יורק

פסיכולוגים חברתיים מתעניינים זה זמן רב באופן שבו אנשים יוצרים רשמים של אחרים. חלק גדול מעבודה זו התמקד בטעויות שאנשים עושים בשיפוט אחרים, כגון ההשפעה המוגזמת של תכונות מרכזיות (כגון “חם” ו”קר “), המשקל הלא מספיק שניתן להקשר שבו מתרחשת התנהגותם של אחרים, והנטייה של אנשים לשפוט אנשים התואמים את הציפיות הראשוניות שלהם לגבי אחר. עם זאת, התמקדות זו בשגיאות מסווה את העובדה שאנשים די טובים בקבלת החלטות מדויקות למדי על המאפיינים של אנשים אחרים, יכולת שללא ספק הייתה חשובה במהלך האבולוציה האנושית.

אכן, היכולת האנושית להבין במהירות מצבים חברתיים ואנשים מדורגת בין הכישורים החשובים ביותר שלנו. מה שמרשים במיוחד ביכולת שלנו להבין אחרים הוא לא רק כמה מעט מידע אנחנו צריכים כדי להסיק מסקנות, אלא כמה מכוילים אנחנו יכולים להיות עם כל כך מעט מידע. וידאו זה מציג כמה טכניקות ניסיוניות המשמשות חוקרי פסיכולוגיה, כולל אמבדי ורוזנטל בעבודתם המכוננת, 1 ובוחן אתתהליך ההסקות בהקשר של הערכות התלמידים של מוריהם.

Principles

Procedure

1. לארגן חומרים. צור קטעי וידאו, הכוללים צילומים שצולמו בעבר של 10 מדריכים במכללה. תוכן ההוראה צריך לכסות מגוון רחב של תחומי נושא. עבור כל מורה, זהה שלושה קליפים נפרדים של 10 שניות. יש לקחת את שלושת הקליפים מההתחלה, מהמרכז ומהסוף של השיעור, בהתאמה, ולהציג את המורה לבד במסגרת הווידאו.</l…

Results

Results indicated that nine of the 15 molar ratings of nonverbal behavior positively correlated with end-of-semester ratings of teacher effectiveness (Figure 1), as did the overall mean molar rating. Molecular behaviors, on the other hand, were less predictive (Figure 2); only frowning and fidgeting (negatively) correlated with teaching effectiveness (Figure 3). Teacher attractiveness did not significantly relate to teacher effectiveness. More importantly, the effects of nonverbal behavior remained even after statistically controlling for attractiveness. Thus, when given only 30 s of film from one day of instruction, assessments of nonverbal behaviors correlated very highly with students' impressions of their teachers based on a semester's worth of contact.

Figure 1
Figure 1: Correlations of molar nonverbal behaviors and students' ratings of teacher effectiveness. Molar nonverbal behaviors (i.e., trait judgments) from the thin-slice video clips were correlated with students' end-of-semester ratings of teacher effectiveness. Ten of the 15 molar nonverbal behaviors predicted ratings of teacher effectiveness (optimistic, confident, dominant, active, enthusiastic, global variable, likable, warm, competent, supportive).

Figure 2
Figure 2: Correlations of molecular nonverbal behaviors and molar global rating. Molecular nonverbal behaviors (i.e., specific nonverbal actions) from the thin-slice video clips were correlated with the teachers' overall molar global rating. Only frowning was negatively correlated.

Figure 3
Figure 3: Correlations of molecular nonverbal behaviors and students' ratings of teacher effectiveness. Molecular nonverbal behaviors (i.e., specific nonverbal actions) from the thin-slice video clips were correlated with students' end-of-semester ratings of teacher effectiveness. Fidgeting was negatively correlated with the criterion variable: Teachers who fidgeted more with their hands or fiddled with an object, such as chalk or a pen, received significantly lower ratings from their students.

Applications and Summary

The described technique demonstrates that observing just 30 s of behavior is enough to draw accurate inferences about teaching effectiveness. Ambady and Rosenthal repeated this study using even shorter clips and found similar effects: Judgments based on three clips as short as 2.0 s yield high correlations with end-of-semester ratings.1 Knowledge of the nonverbal correlates of effective teaching help our understanding of the importance of affective behavior in teaching and learning processes, and are also of practical importance in guiding the selection and training of future teachers.

This body of research has been extended beyond judgments of teaching effectiveness. Research has shown that people can judge how trustworthy an individual is just from viewing a photo of that person for a few brief seconds. Others have found that people can predict who will win an election with above-chance accuracy just based on viewing photos of the candidates. The ability to quickly infer another person's character or traits from a brief exposure is referred to as thin slicing.

People can thin slice others with an impressive degree of accuracy. However, this accuracy depends in large part on knowing which factors are important. For example, research conducted by relationship expert John Gottman and colleagues shows that divorce can be predicted at higher-than-chance levels by viewing a thin slice of video of a couple interacting.2 Gottman identified four key behaviors that predict divorce: criticism, contempt, defensiveness, and withdrawing/stonewalling. Interestingly, complaining and anger actually do not predict divorce.

In addition, many professions rely on accurate thin-slicing, ranging from detective work and personal security to poker playing and psychic reading. It may be that implicitly or explicitly learning to attune to the right signals is crucial to developing this expertise.

References

  1. Ambady, N. & Rosenthal, R. (1993). Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality and Social Psychology, 64, 431-441.
  2. Gottman, J. M., Coan, J., Carrere, S., & Swanson, C. (1998). Predicting marital happiness and stability from newlywed interactions. Journal of Marriage and Family, 60, 5-22.

Transcript

Upon meeting new people, many individuals tend to make quick judgments of another person—even without much information to go on.

For instance, at a social gathering, someone might immediately think that the guy with cool glasses, whom they’ve never met, is likeable based solely on his appearance. As it turns out, he is easy-going and has a lot of friends.

Remarkably, people are surprisingly accurate when making these first impressions—referred to as snap judgments—simply based on visual cues.

Based on the seminal work of Ambady and Rosenthal, this video demonstrates the experimental techniques used to make snap judgments of instructors’ personalities in comparison to actual evaluations of their teaching effectiveness. We will also explore how such inferences can be applied to other professions that rely on analyzing characteristics.

In this study, participants are asked to watch short, muted video compilations of novel college instructors teaching a variety of subjects and must judge certain attributes. Other trained coders count more specific nonverbal behaviors, as well as rate their physical appearance.

These assessments are ultimately compared to actual teaching evaluations to examine the accuracy of first impressions based on visual traits and distinct, objective actions.

Participants first provide molar ratings—broad trait judgments—based on 15 teaching-related dimensions, such as whether they seem enthusiastic, likeable, and confident. The Likert scale ranges from 1 (not at all) to 9 (very).

In addition, research assistants watch the same clips and tally molecular behaviors—actions that are momentary and discrete—like smiling or nodding. They are also asked to report on the teacher’s symmetry and body posture.

Lastly, based on a single photo taken from the videos, the assistants are asked to rate the physical appeal of each instructor on a 5-point Likert scale, where 1 means “not at all” and 5 equals “very”, to account for effects of attractiveness.

To examine the predictive utility of these snap judgments, each instructor’s end-of-semester teaching evaluations are compiled for nonbiased quantitative comparisons.

Using these forms, the dependent variable is teaching effectiveness, based on averaging two items where students rated the instructors’ performances and overall quality of the courses.

Ultimately, participants’ assessments of molar nonverbal behaviors—given 30 s of film from one day of instruction—are expected to be highly correlated with students’ evaluations of their instructors, which are based on a much longer span—a semester’s worth of interaction.

These findings suggest that very little time is needed to make an accurate first impression, which is known as thin slicing—the ability to quickly infer another person’s character from a very short exposure.

Prior to the experiment, conduct a power analysis to recruit a sufficient number of participants. Additionally, use previously filmed footage of ten college instructors to generate three separate, 10-s clips from each to end up with a total of 30 videos.

For every one, capture a frame to save as their photo for subsequent observations. To complete preparation, compile the end of semester student evaluations for each of the 10 instructors shown, from the actual courses that correspond to the footage.

To begin, escort each participant into the testing room and explain that they will watch videos and assess molar nonverbal behavior—in this case personality traits.

As they view each set of randomized clips, have them judge every instructor’s nonverbal behavior—15 teaching-related adjectives—on a 9-point Likert scale.

Next, to measure molecular nonverbal behavior, ask two trained coders to watch the same segments and tally the number of times each instructor makes one of 12 distinct behaviors, along with details about their symmetry and body posture.

Lastly, to account for the effects of attractiveness, have each coder view the saved images and judge the physical appearances of each instructor on a 5-point Likert scale.

To conclude the experiment, fully debrief participants regarding the actual purpose and procedures of the study.

To compile the data, make sure that the two evaluation responses have been converted into percentages and averaged for each instructor.

Then, create separate graphs to compare the mean values of molar and molecular categories against teaching effectiveness. Plot the correlations for each nonverbal behavior measured.

First, notice that 10 of the 15 molar ratings of nonverbal behavior were significantly and positively correlated, including the overall composite average—the global variable.

However, molecular behaviors were less predictive. Only fidgeting negatively correlated with teaching effectiveness. Moreover, the relationships remained even after controlling for instructor attractiveness.

In the end, students were able to formulate reliable impressions of instructors’ teaching effectiveness using only 30 s of nonverbal video footage.

Now that you are familiar with how to design a study to evaluate snap judgments in an educational setting, let’s look at how this research extends to other professions that rely on quick inferences to understand other people’s character.

During a poker game, many players rely on snap judgments to size up their competition. Those who make quick inferences about their opponents’ playing style—solely based on a limited amount of visual cues—can win the pot.

However, maintaining accuracy when thin-slicing others depends largely on knowing which factors are important. For example, researchers have shown that divorce can be predicted above chance levels by viewing a very short video of a couple interacting.

In this case, the expected behaviors of complaining or anger did not predict divorce, but rather, defensiveness and withdrawing did. Thus, it may be that implicitly or explicitly learning to attune to the right signals is crucial to developing this expertise.

You’ve just watched JoVE’s video on how to evaluate the accuracy of snap judgments. Now you should have a good understanding of how to design, conduct, and analyze an experiment to study how only a short time is needed to make predictive inferences, as well as how this skill can be useful in other professions.

Thanks for watching!

Tags

Cite This
JoVE Science Education Database. Education. Evaluating the Accuracy of Snap Judgments. JoVE, Cambridge, MA, (2023).