Name: testing multiple conditions in one study
Uploaded: 2023-04-30T06:36:19.000Z
Duration: 7 min 35 s
Channel: JoVE

1. Introduction of topic/research question
<ol>
	<li>Research question: People are unique and different, yet mostly the same. When it comes to interacting with other ethnicities, which perspective is better? We could focus on and appreciate our differences (a multicultural perspective), or focus on the many similarities we share (a color blind perspective). If one is more effective, does it have to be explicit (i.e., does the person need to realize it)? The researcher then forms a hypothesis based on educated guesses about potential answers.</li>
	<li>Research Hypothesis: Those who are exposed to the multicultural perspective will display more favorable attitudes toward an outgroup member than those who are exposed to the colorblind perspective.&#160;</li>
</ol>
2. Key variables
<ol>
	<li>Variable: Anything that changes in a study</li>
	<li>Independent variable: The cause or what the researcher manipulates/changes in order to detect changes in the participant</li>
	<li>Based on the hypothesis, interethnic ideology is the independent variable.</li>
	<li>Dependent variable: The effect or the outcome that the researcher measures in the participant</li>
	<li>Based on the hypothesis, attitudes toward an outgroup member is the dependent variable.</li>
</ol>
3. Defining the variables
<ol>
	<li>Interethnic Ideology: To manipulate the independent variable of interethnic ideology, have participants perform a word search (so that participants will not explicitly know they are being exposed to the different ideologies).</li>
	<li>Attitudes toward an outgroup member: To measure the dependent variable of perceived attractiveness, have the participant choose a seat (near or far from the outgroup member).</li>
</ol>
4. Establishing conditions
<ol>
	<li>Levels: The independent variable&#8217;s number of conditions or groups
	<ol>
		<li>In simple experiment, there are two levels (experimental group and control group).</li>
		<li>In a multi-group experiment, there are more than two levels.</li>
	</ol>
	</li>
	<li>Potential conditions/groups
	<ol>
		<li>Two or more types of treatment (such as this study)</li>
		<li>Placebo</li>
		<li>Empty-control groups (included in this study)</li>
	</ol>
	</li>
	<li>Experimental Conditions: Groups who receive different types of the key ingredient
	<ol>
		<li>Multicultural Group: Word search with multicultural terms, as well as 5 distractor words to minimize hypothesis guessing
		<ol>
			<li>Hypothesis guessing: When a participant actively tries to figure out what the study is about, which can lead to unnatural responses</li>
		</ol>
		</li>
		<li>Color Blind Group: Word search with color blind terms, as well as 5 distractor words (same ones as the multicultural group) to minimize hypothesis guessing</li>
	</ol>
	</li>
	<li>Placebo Condition: A condition that doesn&#8217;t receive any treatment, but participant&#8217;s believe they are
	<ol>
		<li>Though we do not include one in this study because participants likely won&#8217;t realize that they are in an experimental group, a placebo condition is often useful if we want to see how participants act if they believe they are receiving a treatment, but actually aren&#8217;t. Placebo groups generally help us get a handle on how participants&#8217; expectations influence outcomes in our dependent variable.</li>
	</ol>
	</li>
	<li>&#160;Control Condition: This group does the same thing as experimental groups without the key ingredient.&#160;
	<ol>
		<li>They will do a word search with common everyday words that aren&#8217;t associated with multicultural or colorblind perspectives.</li>
	</ol>
	</li>
	<li>Empty Control Condition: A group that does not receive any type of treatment or &#8220;key ingredient.&#8221;&#160; This provides a baseline that shows how participants act without any treatment.
	<ol>
		<li>They will not do any word search.</li>
	</ol>
	</li>
</ol>
5. Confounds
<ol>
	<li>What it is: Anything the researcher accidentally changes along with manipulation</li>
	<li>Its importance: The presence of a confound makes it impossible to know if the treatment or &#8220;key ingredient&#8221; is responsible for the changes in the dependent variable.</li>
	<li>Application to study: In the present study, the researcher must be careful that the word searches are all as similar as possible. If one had 10 words to find, while another had 5, that would be a confound. If one was on white paper, while another was on yellow, that would be a confound.</li>
</ol>
6. Measuring the dependent variable (attitudes toward an outgroup member)
<ol>
	<li>Seat choice
	<ol>
		<li>Key measurement considerations: Need to set up 8 chairs in a room with the outgroup member&#8217;s belongings on the far left chair. This gives the participant 7 seats to choose from.</li>
		<li>Higher score indicates more positive attitude toward outgroup member (Table 1).</li>
	</ol>
	</li>
</ol>
<table border="1" cellpadding="0" cellspacing="0">
	<tbody>
		<tr>
			<td>Chair with Belongings</td>
			<td>Empty Chair</td>
			<td>Empty Chair</td>
			<td>Empty Chair</td>
			<td>Empty Chair</td>
			<td>Empty Chair</td>
			<td>Empty Chair</td>
			<td>Empty Chair</td>
		</tr>
		<tr>
			<td></td>
			<td>7 points</td>
			<td>6 points</td>
			<td>5 points</td>
			<td>4 points</td>
			<td>3 points</td>
			<td>2 points</td>
			<td>1 point</td>
		</tr>
	</tbody>
</table>
Table 1. Point distribution based on seat choice. More points are given to the chair chosen near the outgroup member&#8217;s belongings.
7. Conducting the study
<ol>
	<li>Setting = Research lab and adjoining room with 8 chairs</li>
	<li>Informed consent
	<ol>
		<li>In a research lab, meet the participant for study on &#8220;Word Searches.&#8221;</li>
		<li>Go through informed consent: &#8220;Here is the informed consent, which outlines what the study is basically about, any risks/benefits of participation, and lets you know that you are free to quit at any time.&#8221;&#160;</li>
	</ol>
	</li>
	<li>Random assignment to condition
	<ol>
		<li>Randomly order the packets so that the participant&#8217;s condition (multicultural, colorblind, control, or empty control) is not based on anything other than chance. Otherwise, the researcher may subconsciously be more likely to assign certain participants (e.g., those who look physically fit) to certain conditions (e.g., running).&#160;</li>
	</ol>
	</li>
	<li>Running the study
	<ol>
		<li>Give participant randomly assigned word search (need to highlight the words they are searching for to show the ones associated with multicultural and colorblind, as well as the distractor words&#8212;in italics. The word search for the control group contains all mundane words.
		<ol>
			<li>Multicultural: culture, variety, difference, diversity, multi, flowers, stars, artistic, world, music</li>
			<li>Color-blind: equality, unity, sameness, similarity, blind, flowers, stars, artistic, world, music</li>
			<li>Control: practical, relaxed, logic, creativity, friendship, flowers, stars, artistic, world, music</li>
			<li>Empty Control: nothing; Say you ran out of word searches for the first part.</li>
		</ol>
		</li>
		<li>Measure of attitudes toward an outgroup member&#160;
		<ol>
			<li>Escort participant to adjoining room for Part 2.&#160;</li>
			<li>&#8220;For the next part of this study, you are going to work together with the following partner (hands participant a picture) on additional word search tasks. They&#8217;ve already arrived, but had to run out to their car to get something. Please have a seat.&#8221;</li>
			<li>Walk to a different part of the room and note the participant&#8217;s seat selection.</li>
		</ol>
		</li>
	</ol>
	</li>
	<li>Debriefing
	<ol>
		<li>Explain the purpose of the study to the participant: &#8220;Thank you for participating. In this study I was trying to determine if different interethnic ideologies influenced attitudes toward someone different than you. Specifically, I focused on a multicultural perspective, which is the idea that we should celebrate differences and the colorblind perspective, which is the idea that we should ignore differences and focus on shared similarities. I manipulated those based on the words participants searched for in Part 1. There were also control groups, one who searched for neutral words, and one who didn&#8217;t search for any. Do you have any questions?&#8221;</li>
	</ol>
	</li>
	<li>Address deception.
	<ol>
		<li>Explain: &#8220;It is important that we get a natural performance, not one that the participant feels is expected. If participants were to know the true reasoning and hypothesis behind the study, they may perform in an unnatural way by trying to live up to the experimenters&#8217; perceived expectations. To eliminate this problem, it is necessary for me to mislead you about the true nature of the word search and the fact that there was an outgroup member who you were paired with in Part 2. In actuality, the word searches were part of my manipulation and there wasn&#8217;t anyone in Part 2. Rather, we used the same picture of another participant for everyone. Because of the nature of how we did the study, it is quite natural for participants to have believed there was another person, but rest assured there wasn&#8217;t.&#8221;&#160;</li>
	</ol>
	</li>
</ol>

The results of this study replicate previous research showing the benefits of a multicultural perspective. This study adds to existing literature by showing how it can be manipulated in a non-explicit way and can influence an overt behavior like choosing where to sit.
Considering the potential benefits of seeing others&#8217; differences, it is easy to see how this might apply in a variety of contexts such as attitudes toward sexual minorities, anti-bullying efforts in schools, divorce mediati...

the multi-group experiment

Source: Laboratories of <a href="https://www.jove.com/author/Gary_Lewandowski">Gary Lewandowski</a>, Dave Strohmetz, and Natalie Ciarocco&#8212;Monmouth University

A multi-group design is an experimental design that has 3 or more conditions/groups of the same independent variable. This video demonstrates a multi-group experiment that examines how different interethnic ideologies (multiculturalism and color-blind) influence feelings about diversity and actions toward and out-group member. In providing an overview of how a researcher conducts a multi-group experiment, this video shows viewers how to distinguish levels in variables, common types of conditions/groups to use (including placebo and empty-control conditions/groups), the process of conducting the study, the collection of results, and the consideration of their implications.&#160; &#160;

After collecting data from 88 people, perform a one-way analysis of variance (ANOVA) comparing the four conditions/groups (multicultural, colorblind, control, and empty control) to see how they influenced attitudes toward the outgroup member. As shown in Figure 1, those in the multicultural group had the most favorable attitude compared to all other conditions.
<img alt="Attitude toward outgroup member bar chart; analyzes multicultural, co...

The Multi-group Experiment

Source: Laboratories of Gary Lewandowski, Dave Strohmetz, and Natalie Ciarocco&#8212;Monmouth University

A multi-group design is an experimental design ...

Choosing the correct experimental design is essential to answer the specific scientific question at hand.In an experiment, researchers are concerned with variables?what changes. For instance, the researcher manipulates the independent variable to detect possible differences amongst participants.The independent variable can have different?levels, also known as conditions, which may result in different outcomes?what the researcher measures as the dependent variable.If an independent variable has three or more conditions, the experiment consists of a multiple-group design. This is in contrast to a simple experimental design, which contains two levels, the experimental and control groups.Each design is used to answer different questions; a two-group design tells you whether the independent variable has any effect, whereas a multiple-group design tells you how much of an effect each condition has.Using a multi-group approach, this video demonstrates how to design levels of variables and conduct the study, as well as how to analyze data and interpret participants? attitudes towards complex ethnic interactions.In this multi-group experiment, participants are randomly assigned to one of four conditions: Colorblind, Multicultural, Control, or an Empty-Control group.Two of the groups, Colorblind and Multicultural, are considered main experimental conditions, in which participants are unknowingly exposed to diverse perspectives through a word search task that focuses on shared similarities or appreciative differences.In contrast, participants in the Control group are exposed to a mundane word search task that lacks any perspective, whereas participants in the Empty-Control group are not exposed to the task. This latter condition provides a baseline response of how participants act without any treatment.For the word search task, participants are given words that relate to the attitudes of their assigned conditions. For example, colorblind words include: equality, unity, sameness, similarity, and blind; multicultural words include: culture, variety, difference, diversity, and multi; and control words include: practical, relaxed, logic, creativity, and friendship.In addition, all of the word searches contain the same five distractor words: flowers, stars, artistic, world, and music. The distractors are included to prevent participants from guessing what the true nature of the study is?a concept referred to as hypothesis guessing.Following the word search task, all participants are handed a photograph of someone they think will help them complete additional tasks when they return. In reality, the photograph represents a member of a social group with whom the participant does not identify?the outgroup member.The dependent variable?the participants? attitudes toward the outgroup member?is then quantified by how close they choose to sit near their supposed partner?s belongings. Note that the outgroup member never makes a physical appearance.In this case, choosing to sit closer represents a more positive attitude towards the outgroup member versus sitting farther away.It is hypothesized then that those who are exposed to the multicultural perspective will display more favorable attitudes toward an outgroup member when compared to those who are exposed to the colorblind perspective.To conduct the study, create three different word searches that consist of five words associated with colorblind, multicultural, or mundane attitudes. Make sure that each search includes the same five distractor words.Randomly organize the word searches inside packets to ensure that participants? assignments are entirely based on chance and not any preconceived assumptions about the participant. Note that the packet for the Empty-Control group is indeed empty.In an adjoining room, set up eight chairs. Place the outgroup member?s belongings on the far left chair, giving the participant seven seats to choose from.To begin the experiment, meet the participant at the lab. Provide each participant with informed consent, which consists of a brief description of the research and procedures, and the potential risks and benefits of participating.To assign the conditions, hand all participants a word search packet, except for those assigned to the Empty-Control group.Once the word search is finished, escort the participant to an adjoining room. Hand each participant the same photograph of another person?the outgroup member?and tell them that they will now work together with this person on additional word search tasks upon their return.Further explain to the participant that their partner has already arrived, but had to run out to their car to get something. Tell them to have a seat.After participants choose their seat, walk to a different part of the room and note each one?s seat selection.At the conclusion of the experiment, debrief participants by telling them the nature of the study.Explain that deception was necessary to capture the participants? natural reactions, as divulging the true intentions of the study beforehand could have influenced their behavior to meet perceived expectations.To analyze how different perspectives influence participants? attitudes, average the seat choice scores in each group and plot the means across the four conditions. To determine if group differences were found, perform an analysis of variance comparing the four groups.Note that those in the multicultural group sat closer to the outgroup member, which translates to a higher attitude score. Thus, the exposure to the multicultural ideology led to the most favorable attitude as compared to all other conditions.Now that you are familiar with multiple group designs, let?s take a look at how other researchers manipulate conditions to maximize experimental control.For example, to determine the relationship between time spent sleeping and exercise performance, multiple groups are needed. That way, an optimal amount of sleep can be determined, where ultimately the longest amount of sleep may not help, but rather hurt, exercise performance.Similarly, a multiple group design would be necessary to determine the optimal dose of a medication that achieves the desired outcome without side effects.A multi-group design is also beneficial to test whether participation in a dance class relieves depression symptoms. In this case, adding a group exposed to social interaction without dancing controls for a potentially confounding variable?the inadvertent social interaction derived from the class.You?ve just watched JoVE?s introduction to multi-group experimental design. Now you should understand how to design a multi-group experiment by including different levels of the independent variable.Using a specific example, the video demonstrated how to conduct a multi-group experiment, as well as how to evaluate the results. Finally, through a discussion of applications, you should have a good understanding of how multi-group experimental design can be used to meet specific research needs.Thanks for watching!?

Education

JoVE Science Education

Psychology

Experimental Psychology

testing multiple conditions in one study

A multi-group experiment tests three or more conditions of the same independent variable. It lets researchers compare how each condition affects the outcome they measure. In this study, the conditions examine different interethnic ideologies and their effects on feelings about diversity and actions toward an out-group member.

The video also shows how to tell levels in a variable apart and how to choose common study conditions. These can include placebo and empty-control conditions, which help provide points of comparison. It then follows the process of running the study, collecting results, and thinking about what the findings mean.

Testing Multiple Conditions in One Study

from theory to design: the role of creativity in designing experiments

from-theory-to-design-the-role-of-creativity-in-designing-experiments

Creative Study Design in Social Psychology

Creative study design helps social psychology researchers test ideas about human thought, emotions, and behavior. Many research questions begin with a theory that suggests a possible explanation for everyday life. Some of those ideas are hard to study directly, so researchers need a careful plan to test them. One example is a theory about Facebook perception. Researchers asked whether a person’s image on Facebook is influenced by the appearance and comments of that person’s Facebook friends.

ethics in psychology research

Psychology Research Ethics and Aggression

Psychology research ethics guide how scientists study aggression while protecting participants. Researchers aim to make studies as real-world as possible, but they must also balance that goal with the best interests of the people taking part. Ethical choices begin early, when researchers decide how to measure or change a variable and then choose the safest option. Aggression is an important behavior to study because it can help explain interpersonal violence. A student who gets a poor grade on...

realism in experimentation

Mundane Realism in Lab Experiments

Mundane realism helps lab experiments feel like real life. It is used when researchers want a setting that matches how people normally behave. In some studies, the real world is the best place to observe behavior directly. For example, voting behavior is easier to study by watching people vote. But real-world research is not always ethical or practical. A lab gives researchers more control over the setting. That control helps them identify the exact variables that may influence an outcome. To...

perspectives on experimental psychology

Psychology Research Methods in Practice

Psychology research methods are shown through real experiments in this JoVE K12 collection. The pages let high school students watch studies from start to finish. They also show the experiments in their natural setting, inside the actual research process. The collection is useful because experimental psychology can be hard to connect to from a textbook alone. These videos give students exposure to more than a dozen topics they may not otherwise see. They can help bring abstract ideas to life...

pilot testing

Testing Stress Manipulations Before the Study

Pilot testing helps researchers check whether a manipulation works before they run the main study. In psychology, researchers need study experiences that are consistent, or reliable, and authentic, or valid. Pilot testing lets them try out a manipulation first and see if it produces the intended effect. This study focuses on acute stress, which is short-term stress caused during a task. The researchers compared three ways to create that stress. They tested static, a ticking clock, and a crying...

observational research

Behavior Clues in Psychological Research

Behavior clues can help psychologists study how people think and feel. Researchers may ask people directly, or they may watch what people do and look for signs of past behavior. These observations can add useful information, especially when self-reports are limited. Behavior is not always a perfect guide to a person’s real state. A person may smile and seem happy, but they could actually be annoyed and just trying to be polite. Science tries to move past self-view alone because a person’s own...

the simple experiment: two-group design

Testing Attraction with a Simple Experiment

A simple experiment uses a two-group design to test a cause-and-effect relationship between two variables. In this setup, a researcher compares two groups to see whether one factor changes the outcome. The video follows a research question about how physiological arousal, or excitement, influences perceived attraction. It shows how an idea becomes a testable idea and how a hypothesis is formed. The experiment variables are identified, and experimental conditions and controls are created. The...

A multi-group experiment tests three or more conditions of the same independent variable. It lets researchers compare how each condition affects the outcome they measure. In this study, the conditions examine different interethnic ideologies and their effects on feelings about diversity and actions toward an out-group member. The video also shows how to tell levels in a variable apart and how to choose common study conditions. These can include placebo and empty-control conditions, which help...

within-subjects repeated-measures design

Repeated-Measures Study with Counterbalancing

A repeated-measures study uses the same participants in every condition of an experiment. In this design, each person receives every level of the independent variable. A simple example is a candy taste test, where each participant tastes and rates each type of candy. This psychology experiment looks at how motivational messages affect willingness to exert physical effort. The message types include hard work, self-affirmation, outcomes, and positive affect. Each participant reads all four...

the factorial experiment

Main Effects and Interactions in Factorial Designs

A factorial design uses two or more independent variables in one experiment. A 2 x 2 factorial design is a common example. It lets students see how more than one factor can shape an outcome at the same time. This experiment uses self-awareness and self-esteem as the two independent variables. It explores whether they affect the ability to decipher nonverbal signals. The design also shows how a factorial experiment differs from other designs and why it can be useful. A key part of this topic...

self-report vs. behavioral measures of recycling

self-report-vs-behavioral-measures-of-recycling

Behavioral Observation in Recycling Studies

Behavioral observation can give a more direct measure of recycling behavior than self-report. Self-report means asking people to describe their feelings, thoughts, or actions. In some cases, participants may not be fully honest. Observing what people actually do can help researchers measure behavior more accurately. This study uses a multi-group experiment to test whether feeling close to others leads to more positive attitudes toward environmental consciousness. Researchers measured the...

reliability in psychology experiments

Content Analysis and Reliability in Psychology

Reliability in psychology is important when researchers try to measure something that is hard to quantify. In content analysis, reliability helps show whether the measurement is consistent. The video uses a simple two-group design to show how this works. The example compares two cartoons, SpongeBob SquarePants and Caillou, to ask whether one has more inappropriate content than the other. The transcript also connects this topic to a recent Pediatrics study on 4-year-olds. That study found worse...

placebos in research

Yoga Expectations and the Placebo Effect

Yoga expectations can influence how researchers measure creativity. Clinical research often tests whether a treatment really works for a disorder or illness. A common challenge is that participants may already believe a treatment will help. Those expectations can affect the results and make it harder to tell what the treatment actually did. Yoga is a good example because it has many claimed benefits in the United States, including improved creativity. But it is not always clear whether yoga...

manipulating an independent variable through embodiment

manipulating-an-independent-variable-through-embodiment

Embodiment Effects in a Weight Experiment

Embodiment can affect how people think and act in an experiment. It is a research idea that says subtle physical experiences may influence thoughts without people realizing it. Researchers use this idea to see how a simple body sensation can change later judgments. Researchers often manipulate participants in one group so they have different thoughts, experiences, or feelings than people in other groups. Some manipulations are obvious, and others are subtle. In this study, the key physical...

experimentation using a confederate

Using Confederates in Social Experiments

Confederates are used in social experiments to help researchers study how people react in a controlled setting. A confederate is a person who seems like a normal participant but follows the researcher’s directions instead. This helps create conditions that feel natural while still keeping the experiment organized. The study shown here uses a two-group design to test imitation. Researchers asked whether participants were more likely to copy a person with more power than a person with similar...

experimental psychology

This collection provides a framework for observing how psychological experiments are embedded in the actual research process, starting from the initial research design to arriving at conclusions in a study. 

See how a multi-group experiment compares three or more conditions, including placebo and control groups, to study interethnic ideologies and diversity attitudes.

Testing Multiple Conditions in One Study

Description

Transcript

Tags