Name: hypothesis test results with p-values
Uploaded: 2023-04-30T12:24:48.000Z
Duration: 1 min 9 s
Channel: JoVE

K12 Standards

Virginia  Standards of Learning

HIgh School

Physical Science

PS.1

PS.1.a

Decision Making: P-value Method

The P-value method uses a calculated P-value instead of the critical value to arrive at a decision about the hypothesis.
As a first step, a hypothesis is stated and expressed symbolically.
For testing the proportion, mean, or standard deviation of a population, the null and alternative hypotheses are expressed as follows.
As a next step, a significance level &#945; is decided, which commonly is either 0.05 or 0.01.
Further, an appropriate test statistic is chosen and calculated using the sample data.
This test statistic is then used to compute the P-value directly.
The P-value is the probability of getting a test statistic value at least as extreme as the one obtained from sample data. We can plot a distribution that shows the given test statistic and P-value.
If the computed P-value is equal to or smaller than the decided significance level, we reject the null hypothesis; otherwise, we fail to reject the null hypothesis.

decision making: p-value method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim&#160; is also stated. These statements can act as null and alternative hypotheses:&#160; a null hypothesis would be a neutral statement while the alternative hypothesis can have a direction. The alternative hypothesis can also be the original claim if it involves a specific direction about the population parameter.
Once the hypotheses are stated, they are expressed symbolically. As a convention, the null hypothesis would contain the equality symbol, while the alternative hypothesis may contain &#62;, &#60;, or &#8800; symbols.
Before going further in the hypothesis testing, an appropriate significance level must be decided. There is a general consensus to set significance levels at 95% (i.e., 0.95) or 99% (i.e., 0.99) level. Here the &#945; would be 0.05 or 0.01, respectively.
Next, identify an appropriate test statistic. The proportion and the mean (when population standard deviation is known) is the z statistic. For the mean, when the population standard deviation is unknown, it is a t statistic, and for the variance (or SD), it is a chi-square statistic.
After calculating the test statistic, find the P-value electronically or from the respective P-value table, and compare it with the pre-decided significance level. If the P-value is less than the pre-decided significance level, reject the null hypothesis.
The interpretation of the original claim from the hypothesis or the property of the population must be based on the P-value.

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a ...

Education

JoVE Core

Statistics

Unit 1

Hypothesis Testing

KEY TERMS AND CONCEPTS

hypothesis test results with p-values

Hypothesis testing with the P-value method uses sample data to judge a claim about a population parameter. The process starts with a clear research question and a simple statement about the population. An opposing statement is also written so the claim can be tested fairly.

These statements become the null hypothesis and the alternative hypothesis. The null hypothesis is a neutral statement, while the alternative hypothesis can have a direction. In some cases, the original claim is the alternative hypothesis if it includes a specific direction about the population parameter.

After the hypotheses are written, they are expressed in symbols. By convention, the null hypothesis includes the equality symbol. The alternative hypothesis may use &gt;, &lt;, or ≠. The next step is to choose a significance level before any decision is made.

A common significance level is 95% or 99%. This means α is 0.05 or 0.01, respectively. The correct test statistic is then identified. For a proportion, and for a mean when the population standard deviation is known, the z statistic is used. For a mean when the population standard deviation is unknown, the t statistic is used. For variance or standard deviation, the chi-square statistic is used.

Once the test statistic is found, the P-value is calculated electronically or from a P-value table. The P-value is then compared with the chosen significance level. If the P-value is less than the significance level, the null hypothesis is rejected. The final interpretation of the original claim must be based on the P-value and the population property being tested.

Hypothesis Test Results with P-Values

what is a hypothesis?

Testing a Hypothesis with Sample Data

A hypothesis is a statement about a population property or a phenomenon seen in an observation or experiment. It can describe something that is expected or predicted for a group. In statistics, it is a claim that can be tested with data. A hypothesis should be general, but not vague. It should not make a claim with a definite number, quantity, or measurement for a population property. A hypothesis is not judged as right or wrong on its own. It must be examined through data collection and an...

null and alternative hypotheses

Comparing Hypotheses in Statistical Tests

Statistical hypothesis testing starts by comparing two opposing claims. These are the null hypothesis and the alternative hypothesis. They give researchers a way to judge sample data before making a decision. The null hypothesis, written as H0, says there is no difference between the variables. It also says the variables are not related. This idea is often treated as the status quo. The alternative hypothesis, written as H1 or Ha, makes a claim that conflicts with H0. It is the statement the...

critical region, critical values and significance level

critical-region-critical-values-and-significance-level

Rejection Regions and Significance in Tests

Rejection regions and significance level help decide whether to reject the null hypothesis in hypothesis testing. A sample statistic is first turned into a test statistic using the z, t, or chi-square distribution. The critical region is the part of the probability curve where the test statistic leads to rejection of the null hypothesis. This region is also called the rejection region or region of rejection. It can appear in the right tail, left tail, or both tails of the distribution. The...

p-value

P-Value in Hypothesis Testing

P-value is a key idea in statistics and hypothesis testing. It stands for probability value. It helps show how likely the observed sample results are if the null hypothesis is true. More exactly, p-value is the probability that another randomly selected sample will produce results as extreme or more extreme than the results from the given sample, assuming the null hypothesis is true. A large p-value suggests that the null hypothesis should not be rejected. However, a larger p-value does not...

types of hypothesis testing

Tail Direction in Hypothesis Tests

Hypothesis tests are classified by the direction of the alternative hypothesis. The null hypothesis is a neutral statement, and the alternative hypothesis is the claim being tested against it. If the null hypothesis says p = 0.5, the alternative can be written as p &gt; 0.5, p 0.5, the critical region lies on the right side of the probability distribution curve. A right-tailed hypothesis test is used in that case. When the claim is p &lt; 0.5, the critical region lies on the left side of the...

Hypothesis testing with the P-value method uses sample data to judge a claim about a population parameter. The process starts with a clear research question and a simple statement about the population. An opposing statement is also written so the claim can be tested fairly. These statements become the null hypothesis and the alternative hypothesis. The null hypothesis is a neutral statement, while the alternative hypothesis can have a direction. In some cases, the original claim is the...

decision making: traditional method

Hypothesis Tests Using Critical Values

Hypothesis tests using critical values follow a traditional decision process in statistics. Students first state a claim about a population parameter and then write the opposite statement. These become the null hypothesis and the alternative hypothesis. The null hypothesis is neutral, while the alternative hypothesis can show a direction. After the hypotheses are set, they are written in symbols. By convention, the null hypothesis includes the equality symbol. The alternative hypothesis may...

hypothesis: accept or fail to reject?

Fail to Reject the Null Hypothesis

Hypothesis testing helps scientists decide whether to reject or fail to reject the null hypothesis. The decision comes from the data, the test statistic, the confidence level, the critical values, and the P-value. These parts work together to show whether the evidence is strong enough to support the alternative hypothesis. When the evidence is weak, it is not correct to say that the null hypothesis has been accepted as true. In statistics, that wording can suggest the null hypothesis has been...

errors in hypothesis tests

Type I, Type II, and Test Power

Hypothesis testing can lead to four outcomes based on the true state of the null hypothesis and the choice to reject or not reject it. If the null hypothesis is true and the decision is not to reject it, that is a correct decision. If the null hypothesis is true but it is rejected, that is a Type I error. A Type II error happens when the null hypothesis is false, but it is not rejected. This is also an incorrect decision. The correct decision when the null hypothesis is false is to reject it.

testing a claim about population proportion

testing-a-claim-about-population-proportion

Population Proportion Tests with z and Binomial

Population proportion tests use hypothesis testing to check a claim about a binomial result. The data must come from random and unbiased samples. The variable must also have only two outcomes, such as success or failure, selected or not selected, or true or false. One common method uses the sample proportion and a normal approximation to the binomial distribution. This approach works when the sample is large enough, the proportion is close to 0.5, and np is greater than 5. Here, p is the...

testing a claim about mean: known population sd

testing-a-claim-about-mean-known-population-sd

Z Test for Mean with Known SD

The z test for a population mean uses a known population standard deviation and a normal distribution. It is used when random samples are collected without sampling bias. The sample size should be greater than 30, and the population standard deviation must already be known. In many real situations, the population standard deviation is unknown. In the rare cases when it is known, the claim about the population mean can be tested with the normality assumption and the z distribution. The null...

testing a claim about mean: unknown population sd

testing-a-claim-about-mean-unknown-population-sd

Using the t Test for a Population Mean

Testing a population mean with an unknown standard deviation uses the t test. This method helps estimate a mean when the population standard deviation is not known. It is common in real situations, so the sample standard deviation is used instead. The data should come from randomly selected samples with no sampling bias. The samples should also be approximately normally distributed. There is no specific requirement for sample size, but a different approach is used when the sample size is less...

testing a claim about standard deviation

Chi-Square Test for Standard Deviation Claims

Chi-square hypothesis testing is used to check a claim about population standard deviation or population variance. The data and samples must be random and unbiased. The population distribution must also be normal. The test starts by stating the null and alternative hypotheses clearly and in symbolic form. The claim usually gives a specific value for the population standard deviation or variance. A sample standard deviation or variance is then used to calculate the test statistic. The critical...

key terms and concepts

Learn how to set up hypotheses, choose a significance level, find the right test statistic, and use the P-value to decide whether to reject the null hypothesis.

Hypothesis Test Results with P-Values | JoVE K12

statistics

JoVE Core Statistics introduces the concepts and application of the collection, analysis, presentation, and interpretation of data to students. These animated lessons provide an understanding of statistics beneficial to students from a wide range of disciplines. Additionally, the scientist-in-action videos demonstrate the application of related concepts in classical and original research experiments performed in today's laboratories worldwide

Physics

PH.1

PH.1.a

Scientific Method

The scientific method is used to solve problems and explain phenomena. The development of the scientific method coincided with changes in philosophy ...

What is a Hypothesis?

A hypothesis can be a simple sentence or statement about a property or any phenomenon observed or predicted for a population. It is usually a claim about ...

Null and Alternative Hypotheses

The actual hypothesis testing begins by considering two hypotheses. They are termed&#160; the null hypothesis and the alternative hypothesis. These ...

Types of Hypothesis Testing

There are three types of hypothesis tests: right-tailed, left-tailed, and two-tailed.
When the null and alternative hypotheses are stated, it is observed ...

Introduction to Test of Independence

In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their ...

Hypothesis Test for Test of Independence

The test of independence is a chi-square-based test used to determine whether two variables or factors are independent or dependent. This hypothesis test ...

Decision Making: Traditional Method

The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using ...

empirical-method-to-interpret-standard-deviation

Empirical Method to Interpret Standard Deviation

The empirical rule, also known as the three-sigma rule, allows a statistician to interpret the standard deviation in a normally distributed dataset. The ...

Data Collection by Experiments

Data collection is a systematic method of obtaining, observing, measuring, and analyzing accurate information. An experimental study is a standard method ...

Solving Problems in Physics

Problem-solving is the ability to apply general physical principles to specific situations, usually expressed by equations. It is an essential skill in ...

The student will demonstrate an understanding of scientific and engineering practices by asking questions and defining problems
• ask questions that require empirical evidence to answer
• develop hypotheses indicating relationships between independent and dependent variables
• offer simple solutions to design problems

What is an Experiment?

An experiment is a planned activity carried out under controlled conditions. The purpose of an experiment is to investigate the relationship between two ...

Study Design in Statistics

A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research ...

Observational Studies

Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not ...

Experimental Designs

An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are ...

Randomized Experiments

The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally ...

Crossover Experiments

Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in ...

Controls in Experiments

When conducting an experiment, it is crucial to have control to reduce bias and accurately measure the dependent variables. It also marks the results more ...

Bias

Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected ...

Blinding

Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control ...

Clinical Trials

Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and ...

Data Collection by Observations

Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the ...

Data Collection by Survey

The systematic method of obtaining and analyzing accurate information of a population is called data collection. A survey is a standard method of data ...

Units and Standards of Measurement

A physical quantity is defined either by specifying its measurement method or by stating how it is calculated from other measurements. For example, ...

Estimation of the Physical Quantities

On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as ...

/files/media/science-education/science-education-thumbs/14734.jpg

Base Quantities and Derived Quantities

In any system of units, the units for some physical quantities must be specified through a measurement process. These measurements are the base quantities ...

Conversion of Units

Sometimes, there is a need to convert from one unit to another one. For instance, reading a cookbook in which quantities are expressed in units of liters ...

The student will demonstrate an understanding of scientific and engineering practices by planning and carrying out investigations
• independently and collaboratively plan and conduct observational and experimental investigations; identify variables, constants, and controls where appropriate and include the safe use of chemicals and equipment
• evaluate the accuracy of various methods for collecting data
• take metric measurements using appropriate tools and technologies
• apply scientific ideas or principles to design, construct, and/or test a design of an object, tool, process or system

PS.1.b

Review and Preview

Data are individual items of information obtained from a population or sample. Data may be classified as qualitative (categorical), quantitative ...

What is a Frequency Distribution

A frequency is the number of times a value of the data occurs. The sum of all the frequency values represents the total number of students included in the ...

Ogive Graph

An ogive graph is sometimes called a cumulative frequency polygon. It is one type of frequency polygon that shows cumulative frequency. In other words, ...

Histogram

The histogram is a graphical representation in the x-y form of data distribution in a data set. The horizontal x-axis is labeled with what the data ...

Relative Frequency Histogram

The relative frequency depicts the proportion of data points that have each value. The frequency tells the number of data points that have each value. ...

Scatter Plot

The most common and easiest way to display the relationship between two variables, x and y, is a scatter plot. A scatter plot shows the direction of a ...

Time-Series Graph

A time-series graph is a line graph with repeated measurements taken at successive intervals of time. It is also called a time series chart. To construct ...

Bar Graph

A bar graph is also called a bar chart and consists of bars that are separated from each other. It either uses horizontal or vertical bars to show ...

Multiple Bar Graph

As the name suggests, a multiple bar graph is the same as a bar graph but has multiple bars to depict relationships between different data values. One can ...

Pareto Chart

A Pareto chart is a bar graph or a combination of both line and bar graphs. The bar lengths represent the individual values or the frequency, while the ...

Pie Chart

A pie chart (or a pie graph) is a circular graphical chart or a pictorial representation of categorical data. It is divided into slices of pie each ...

What is Central Tendency?

Descriptive statistics describe or summarize relevant characteristics of a sample and aid in the analysis of data of interest. When analyzing large ...

What is Variation?

Apart from the measures of central tendency, distribution, outliers, and the changing characteristics of data with time, an important characteristic of ...

Range

The range is one of the measures of variation. It can be defined as the difference between a dataset&#39;s highest and lowest values. For example, in the ...

Standard Deviation

The most commonly used measure of variation is the standard deviation. It is a numerical value measuring how far data values are from their mean. The ...

Calculating Standard Deviation

The standard deviation is the most common measure of variation. It is a value that tells us how far a data value is from the mean value in a dataset. ...

Variance

&#160;The deviations show how spread out the data are about the mean. A positive deviation occurs when the data value exceeds the mean, whereas a negative ...

Coefficient of Variation

The coefficient of variation measures the dispersion of the data points or distribution around the mean. Using the coefficient of variation, we can ...

Contingency Table

A contingency table provides a way of portraying data that can facilitate calculating probabilities. It is a method of displaying a frequency distribution ...

Statistical Analysis: Overview

An analysis is usually conducted by replicated sampling or repeated measurements on the same sample. This leads to scattered results rather than a single ...

The student will demonstrate an understanding of scientific and engineering practices by pnterpreting, analyzing, and evaluating data
• construct and interpret data tables showing independent and dependent variables, repeated trials, and means
• construct, analyze, and interpret graphical displays of data and consider limitations of data analysis
• apply mathematical concepts and processes to scientific questions
• use data to evaluate and refine design solutions to best meet criteria

PS.1.c

Models, Theories, and Laws

Scientists frequently use models to help them comprehend a specific collection of phenomena. In physics, a model is a condensed version of a physical ...

/files/media/science-education/science-education-thumbs/14686.jpg

Inductive Reasoning

Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in ...

Deductive Reasoning

Deductive reasoning, or deduction, is the type of logic used in hypothesis-based science. In deductive reasoning, the pattern of thinking moves in the ...

The student will demonstrate an understanding of scientific and engineering practices by constructing and critiquing conclusions and explanations
• construct scientific explanations based on valid and reliable evidence obtained from sources (including the students' own investigations)
• construct arguments supported by empirical evidence and scientific reasoning
• generate and compare multiple solutions to problems based on how well they meet the criteria and constraints
• differentiate between a scientific hypothesis, theory, and law

PS.1.d

The student will demonstrate an understanding of scientific and engineering practices by developing and using models
• construct, develop, and use models and simulations to illustrate and/or explain observable and unobservable phenomena
• evaluate limitations of models

PS.1.e

The Scientific Method

Chemistry is an empirical science. Scientists often pose questions to understand the chemistry in everyday life and seek answers to these questions. To ...

The student will demonstrate an understanding of scientific and engineering practices by obtaining, evaluating, and communicating information
• read scientific texts, including those adapted for classroom use, to determine the central idea and/or obtain scientific and/or technical information
• gather, read, and synthesize information from multiple appropriate sources and assess the credibility, accuracy, and possible bias of each publication
• construct, use, and/or present an oral and written argument supported by empirical evidence and scientific reasoning

PS.1.f

Hypothesis Test Results with P-Values

Description

Transcript

Tags

More videos by Standards