Self-report vs. Behavioral Measures of Recycling
Source: Laboratories of Gary Lewandowski, Dave Strohmetz, and Natalie Ciarocco—Monmouth University
One of the challenges in measuring an experimental…
1. Define key variables.
- Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of feeling close to people.
- For the purposes of this experiment, feeling close to people involves a perceived connection including feelings of emotional attachment toward another person or people.
- Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of environmental consciousness.
- For purposes of this experiment, environmental consciousness is defined as a person’s likelihood to value practices that protect the natural world.
2. Conduct the study.
- Meet the participant in a laboratory/classroom.
- Provide participant with informed consent, a brief description of the research (getting students’ opinions on various social issues), a sense of the procedure, an indication of potential risks/benefits, the right of withdrawal at any time, and a manner to get help if they experience discomfort.
- Participant signs informed consent form.
- Direct participant by saying: “For the next part of the study, I’d like you to sit and look at several pictures. Indicate on each of the index cards how close or connected you feel to the image, where 1 = not at all and 10 = extremely.”
- Manipulation (3 conditions): participant is directed to view slides of one of the three following sets of pictures.
- Feeling-Close-to-People condition: 5 pictures of people together
- Feeling-Close-to-Animals condition: 5 pictures of animals together
- Control/No connection condition: 5 pictures of everyday, non-living items
- Give participant 2 surveys (Appendices 1 and 2) and say: “Please take a minute to consider each question and indicate how you feel about each.”
Appendix 1. Survey 1 given to participants. This survey was used to measure attitudes towards recycling.
Appendix 2. Survey 2 given to participants. This survey served as a distractor.- Note that one is the real survey and one is a filler/distractor.
- While the participant completes the survey, pretend to each lunch out of the participant’s sight.
- The meal should have a range of recyclable and non-recyclable items (Recyclable= glass/plastic bottle, paper plate, paper napkin, plastic spoon, and plastic pudding/yogurt container; Non-recyclable= pretzels, grapes, and apple). Also on the table where the meal is eaten is a crumbled up piece of paper and a broken pen.
- When the participant finishes the surveys, ask the participant to help clear off the table where lunch was eaten so he or she can do the next part of the study.
- The room should have two clearly labeled empty bins, one for trash and one for recycling.
- While the participant clears off the table, the researcher should appear busy looking for/preparing the next part of the study.
3. Debrief.
- “Thank you for participating. In this study I was trying to determine if feeling a close connection to other people would influence your environmental consciousness, measured by your recycling attitudes (measured via the survey) and behaviors (measured via how many items you recycled when clearing off the table). There were three groups in the study, one group saw pictures of people together, another group saw pictures of animals, and the other group saw pictures of common items. We hypothesized that those in the feeling-close-to-other-people condition would have more favorable attitudes toward recycling and would recycle more.”
- “We couldn’t tell you about the study’s true purpose or our hypotheses ahead of time because we wanted to get your honest and natural thoughts and reactions. Because of the nature of the deception, it is quite natural for participants to not realize that they were being deceived.”
4. Go through the “Conducting the Study” procedure three times with three different participants: once for the people condition, once for the animal condition, and once for the household items condition.
5. Data Analysis
- Look at the participant’s survey and circle items 3, 5, and 7.
- Explain that these three items comprise the participant’s mean recycling attitude score, while the other items are simply distractors.
- Look in the bins to count the number of properly recycled items. This is the participant’s behavior score.
- Calculate the means by hand.
Psychologists study many aspects of behavior by asking participants to report their own feelings or by directly observing their performance on specific tasks.
While self-report is often used, the authenticity of reported responses is difficult to determine. Therefore, observing participants? behaviors during specific situations provides more reliable data.
Here, psychologists compare two forms of measurement, self-report and behavioral observation, to see if participants? feelings reported through a survey correlate with their actual behavior.
This video demonstrates how to design, conduct, analyze, and interpret an experiment that investigates whether feeling close to others results in more favorable attitudes toward recycling.
During this experiment, participants are randomly divided into one of three groups: Feeling Close to People, Feeling Close to Animals, or No Connection. In this case, feeling close to people or animals involves perceived connections such as emotional attachments toward other people or animals.
Participants are then asked to view slides in which five pictures of people, animals, or non-living household items are shown, according to their group assignment. They are all then given the same two surveys to complete.
The first survey involves self-reported measures regarding environmental practices for protecting the natural world, whereas the second survey serves as a distraction while the researcher creates a scene for participant observations.
In this scene, the researcher pretends to eat lunch out of the participant?s sight. The meal includes a variety of recyclable and non-recyclable items.
After participants finish the second survey, they are asked to help clear off the table where lunch was eaten while the researcher steps away.
The dependent variables, the values reported on the first self-report survey and the number of items that each participant recycled when clearing the lunch table, are compared.
Participants in the Feeling Close to People group are hypothesized to have more favorable attitudes towards recycling and would recycle more items compared to the other groups.
To begin the study, meet the participant in the laboratory. Provide them with informed consent and discuss the overall procedure of the experiment.
Randomly assign each participant to one of three experimental groups: Feeling Close to People, Feeling Close to Animals, or No Connection, to view five pictures of people, animals, or non-living household items, respectively.
To assure that participants pay attention to the images, have each one write down how close or connected they feel to each image on a scale of 1 to 10.
After the participant views the images, hand them two surveys and instruct them to take a minute to consider each question and indicate how they feel.
While the participant fills out the second survey, pretend to eat lunch out of their sight.
After the participant completes the last survey, ask them to help clear off the lunch table while you prepare for the next part of the study. Have them place garbage into the garbage bin and recyclable items in the recycling bin.
When the participant finishes, record how many items were correctly placed into the recycling bin.
To conclude the experiment, debrief the participant and explain why deception was necessary for the experiment.
To analyze the data, first calculate the participants? recycling attitude score for each condition by averaging the ratings from items 3, 5, and 7 on Survey 1. Note that the other items on this survey, as well as the second survey with yes or no questions, serve as distractors. Graph the mean recycling attitude by condition.
Notice that those in the Feeling Close to People condition indicated that they cared more about recycling than controls.
To determine the observed behavioral score, average the number of items that were counted as being correctly recycled for each condition. Graph the means across conditions. Notice that no significant differences were observed between groups.
Notice that participants who reported favoring attitudes towards recycling did not actually engage in the behavior. In other words, participants? feelings were not correlated with their observed behaviors.
Now that you are familiar with how to compare self-report surveys against actual observed behavior, you can apply this approach to other forms of research.?
Several studies have emphasized the importance of measuring behavior over the use of self-reports to better understand emotion. The most thorough studies collect data from a set of questionnaires, as well as correlate the answers with results from a goal-oriented behavioral task.
In addition, individuals with an addiction, such as cigarette smoking, do not always provide reliable answers to self-report questions. Researchers must use alternative methods, such as fMRI or PET imaging, to better understand smoking behavior.
Finally, self-report questionnaires about sleep are only as informative as the individual?s memory or awareness of their sleep behavior. Therefore, using polysomnography to observe participants during sleep is especially useful when trying to understand abnormal occurrences.
You?ve just watched JoVE?s introduction to compare and contrast measurements of self-reporting and observed behavior. Now you should have a good understanding of how to design and conduct this type of study by administering surveys and directly monitoring behavior, as well as how to analyze and interpret the results.
Thanks for watching!?
View the full transcript and gain access to JoVE Science Education videos
Q1: Why is behavioral observation more reliable than self-report in psychology research?
Self-report measures rely on participants' honesty and accuracy, which are difficult to verify. Behavioral observation directly measures what people actually do in specific situations, providing more authentic data. This approach eliminates the gap between what people say they feel and how they truly behave, making observational research observations and correlations a more trustworthy measurement method for understanding human conduct.
Q2: How does the recycling study design compare self-report and behavioral measures?
Participants were randomly assigned to three groups viewing images designed to evoke feeling close to people, animals, or no connection. They completed surveys about recycling attitudes, then unknowingly sorted lunch items into recycling and garbage bins. Researchers compared self-reported environmental attitudes with actual recycling behavior to determine if attitudes predicted actions.
Q3: What did the recycling study reveal about the relationship between attitudes and behavior?
Participants who reported favorable recycling attitudes did not actually recycle more items than control groups. This disconnect demonstrates that self-reported feelings about environmental practices do not necessarily correlate with actual recycling behavior, highlighting the importance of measuring observable actions rather than relying solely on survey responses.
Q4: Why is deception sometimes necessary in behavioral observation experiments?
Deception prevents participants from altering their behavior because they know they are being observed. If participants knew the lunch-clearing task was the actual study, they might consciously recycle more items to appear environmentally conscious. Deception ensures researchers observe genuine, spontaneous behavior rather than performance influenced by awareness of measurement.
Q5: What are dependent variables in this recycling experiment?
The dependent variables are the values measured to assess the experiment's outcome. In this study, they include participants' recycling attitude scores from survey responses and the number of items correctly placed in the recycling bin during the lunch cleanup task. These two measurements allowed researchers to compare self-reported attitudes with actual behavioral performance.
Q6: How does sample size affect the reliability of behavioral research findings?
Psychological studies typically use larger sample sizes than other sciences to better represent the population and account for variability in human behavior. Although the video demonstrated the procedure with one participant, the actual study used 186 participants to ensure findings were reliable and generalizable, reducing measurement error and increasing confidence in conclusions.
Q7: What alternative methods measure behavior when self-report is unreliable?
Researchers use techniques like fMRI and PET imaging to study behaviors such as smoking addiction where self-reports are often inaccurate. For sleep research, polysomnography directly observes brain activity during sleep rather than relying on participant recall. These methods provide objective physiological data that bypasses the limitations of subjective self-reporting.