Definition
An economics and business concept defining a measure, method, or organizational practice used for analysis and decision-making. It specifies how information is generated or used to guide allocation of resources and evaluation of outcomes. It does not ensure correctness without clear assumptions, reliable inputs, and appropriate review of results. It materially affects planning, performance, and risk by shaping decisions and incentives within organizations and markets. The concept is generally stable, though methods and tools evolve over time.
Principle
Principle
The p-value quantifies evidence against the null by locating the observed statistic within the null distribution: smaller p-values indicate rarer outcomes under the null, but do not directly provide the probability the null is true.
Demonstration
Demonstration
A clinical A/B comparison yields p=0.03 for the difference in conversion rates; this suggests that, if the null (no difference) were true, observing an effect this extreme would happen about 3% of the time under the sampling model used.
Misapplication
Misapplication
Interpreting the p-value as the probability that the null hypothesis is true, treating p<0.05 as a binary proof of practical importance, or data-dredging until a small p-value appears without adjustment for multiplicity.
Consequence
Consequence
Appropriate interpretation helps rank evidence and guide decisions in conjunction with effect sizes and confidence intervals; misuse can lead to overconfident claims, publication bias, and irreproducible findings.
Reversal
Reversal
Reversing the emphasis uses likelihood ratios, Bayes factors, or posterior probabilities to express evidence and uncertainty; these alternatives provide different scales and require priors or explicit alternative models.
Boundary
Boundary
Valid as a sampling-theory measure under the specified null and test statistic; not a measure of clinical or economic importance, not a standalone decision rule without context, and unreliable when model assumptions (independence, distribution form) fail.
Semantic Tension
Semantic Tension
P-values compete with other evidence measures (confidence intervals, effect sizes, Bayesian posteriors); tension arises because p-values condense sampling extremeness into a single number that can obscure magnitude and uncertainty.
Synthesis
Synthesis
A P-Value is a sampling-theoretic index of how extreme observed data are under a null model; it is useful for assessing compatibility with the null but must be interpreted alongside effect size, design, and assumptions.