Hypothesis Testing Logic Study Pack
Kibin's free study pack on Hypothesis Testing Logic includes a 6-section study guide, 25 quiz questions, 30 flashcards, and 5 open-ended Explain review questions. Sign up free to track your progress toward mastery, plus upload your own notes and recordings to create personalized study packs organized by course.
Last updated May 28, 2026
Hypothesis Testing Logic Study Guide
Unpack the logic behind hypothesis testing, from null and alternative hypotheses to p-values, significance levels, and Type I and II errors. This pack clarifies how test statistics and tail direction shape your reject-or-fail-to-reject decision.
Key Takeaways
- •Hypothesis testing is a formal procedure for using sample data to evaluate a claim about a population parameter, structured around two competing statements: the null hypothesis and the alternative hypothesis.
- •The null hypothesis always asserts no effect, no difference, or no relationship, while the alternative hypothesis captures the researcher's claim that something has changed or differs from a baseline.
- •A test statistic measures how far the observed sample result falls from what the null hypothesis predicts, expressed in standardized units such as a z-score or t-score.
- •The p-value represents the probability of obtaining a test statistic at least as extreme as the one observed, assuming the null hypothesis is true — it does not measure the probability that the null hypothesis is correct.
- •Researchers compare the p-value to a pre-selected significance level (α, typically 0.05) to decide whether to reject or fail to reject the null hypothesis.
- •Two types of decision errors are possible: a Type I error (rejecting a true null hypothesis) and a Type II error (failing to reject a false null hypothesis), and the probability of each is inversely related under fixed sample size.
- •The direction of the alternative hypothesis — less than, greater than, or not equal — determines whether the test is left-tailed, right-tailed, or two-tailed, which affects how the p-value is calculated.
The Two Competing Hypotheses
Every hypothesis test begins by translating a research question into two mutually exclusive, exhaustive statements about a population parameter — one asserting the status quo and one asserting a specific departure from it.
Null Hypothesis (H₀)
- •The null hypothesis is always a statement of equality or no effect, such as μ = 50 or p = 0.30.
- •It represents the default assumption that any observed difference in sample data is due to random chance alone.
- •The null hypothesis is never directly proven — it is either rejected or retained based on evidence.
Alternative Hypothesis (Hₐ or H₁)
- •The alternative hypothesis contains the claim the researcher is actually trying to support, such as μ ≠ 50, μ > 50, or μ < 50.
- •Its direction (≠, >, or <) must be chosen before data collection, based on the research question — not after examining results.
- •The burden of proof falls on the alternative hypothesis; data must provide sufficient evidence to overcome the null.
Population Parameters vs. Sample Statistics
- •Hypotheses are always written about population parameters (μ, p, σ), never about sample statistics (x̄, p̂).
- •The sample statistic computed from collected data is the evidence used to evaluate those parameter claims.
Significance Level and the Decision Rule
Before collecting data, researchers specify a threshold — called the significance level — that defines how much risk of a wrong decision they are willing to accept when the null hypothesis is actually true.
Significance Level (α)
- •The significance level α is the maximum probability of incorrectly rejecting a true null hypothesis that the researcher considers acceptable.
- •Common choices are α = 0.05 (5% risk) and α = 0.01 (1% risk); the choice should reflect the consequences of a wrong decision in the specific context.
- •Setting α before seeing the data prevents researchers from choosing a convenient threshold after the fact.
Critical Region and Critical Values
- •The critical region is the set of test statistic values extreme enough to warrant rejecting H₀, located in the tail(s) of the sampling distribution.
- •Critical values are the boundary points that separate the critical region from the non-rejection region; for a two-tailed z-test at α = 0.05, the critical values are ±1.96.
- •Any test statistic that falls inside the critical region leads to rejection of H₀.
Test Statistics and the p-Value
Once data are collected, the sample result is converted into a standardized test statistic, and that statistic is used to compute the p-value — the central quantity used to make the final decision.
Calculating the Test Statistic
- •A test statistic measures the distance between the observed sample statistic and the value specified by H₀, scaled by the standard error of the sampling distribution.
- •For a one-sample z-test of a mean, the formula is z = (x̄ − μ₀) / (σ / √n), where μ₀ is the null-hypothesized mean and σ / √n is the standard error.
- •When the population standard deviation is unknown and must be estimated from the sample, a t-statistic is used instead, and degrees of freedom (n − 1) determine the exact t-distribution shape.
Interpreting the p-Value
- •The p-value is the probability of observing a test statistic as extreme as, or more extreme than, the one computed from the sample, given that H₀ is true.
- •A small p-value (below α) means the observed result would be very unlikely under H₀, providing evidence against it.
- •A large p-value does not confirm H₀ is true — it only indicates that the data are consistent with H₀ and do not provide sufficient evidence to reject it.
One-Tailed vs. Two-Tailed p-Value Calculation
- •For a two-tailed test (Hₐ: μ ≠ μ₀), the p-value is calculated as the combined probability in both tails beyond ±|z| or ±|t|.
- •For a one-tailed test (Hₐ: μ > μ₀ or Hₐ: μ < μ₀), only the relevant tail contributes to the p-value, making it exactly half the two-tailed p-value for the same test statistic.
- •The tail direction must match the direction of Hₐ — using the wrong tail is a fundamental error in hypothesis testing.
Unlock the rest of this study guide
- Access the full study pack
- Track your mastery and be test-day ready
- Upload your own notes to build personalized study guides, quizzes, flashcards, and more
About this Study Pack
Created by Kibin to help students review key concepts, prepare for exams, and study more effectively. This Study Pack was checked for accuracy and curriculum alignment using authoritative educational sources. See sources below.
Sources
Question 1 of 25
Your progress is saved after each question and counts toward mastery.
What does the null hypothesis always assert?
Card 1 of 30
Your progress is saved after each card and counts toward mastery.
Concept 1 of 5
Your progress is saved after each concept and counts toward mastery.
Null and Alternative Hypotheses
Explain the difference between the null hypothesis and the alternative hypothesis in your own words. What role does each one play in a hypothesis test, and why must researchers choose the direction of the alternative hypothesis before collecting data?
More in Statistics
See all topics →ANOVA Foundations
Break down ANOVA from the ground up — covering between- and within-groups variance, the F-statistic ratio, degrees of freedom, and why a significant result still requires post-hoc tests to pinpoint which group means differ.
Binomial Distributions
Master the binomial distribution from the ground up — covering the four conditions for a binomial setting, the probability formula P(X = k) = C(n, k) · pᵏ · (1 - p)ⁿ⁻ᵏ, and how to find mean and standard deviation using np and √(np(1 - p)).
Central Limit Theorem
Unpack the Central Limit Theorem and see why sample means form a normal distribution as n grows — even when the population isn't normal. Master key mechanics like standard error (σ/√n), the n ≥ 30 rule, and applying z-scores to sample mean problems.
Confidence Level and Margin of Error
Unpack the mechanics of confidence intervals and margin of error, from how critical values (z* and t*) are chosen to how sample size affects interval width. Master the distinction between z- and t-distributions and what confidence level actually means across repeated samples.
Data Visualization and Distribution Shapes
Visualize how raw data takes shape through histograms, dot plots, and box plots while mastering symmetric, skewed, and uniform distributions — and learn why skewness shifts the mean toward the tail but leaves the median largely unaffected.
Experimental Design and Bias
Unpack the core principles of experimental design — from random assignment and confounding variables to single- and double-blind procedures, placebo controls, and bias types — so you can confidently distinguish true experiments from flawed ones.
Measures of the Center of the Data
Master the three measures of center — mean, median, and mode — and learn how each responds to outliers, skewness, and weighted values. Understand when to use the median over the mean for skewed data like income, and how symmetric vs. skewed distributions shift these measures apart.
Measures of Variability
Unpack the core measures of spread — range, standard deviation, variance, and IQR — and learn when to use each based on data shape and outliers. Covers Chebyshev's theorem and the n − 1 correction for unbiased sample estimates.
Percentiles and Z-Scores
Unpack the relationship between percentiles, z-scores, and the standard normal distribution — covering the z = (x − μ) / σ formula, IQR-based outlier detection, and how standardized scores translate raw data into comparable percentile ranks.
Prediction
Master the mechanics of simple linear regression, from calculating slope and y-intercept using ŷ = a + bx to interpreting r² and avoiding extrapolation pitfalls. Covers when correlation is significant enough to predict and why the point (x̄, ȳ) always anchors the line.