
As a data professional, you’re probably familiar with stats fundamentals. But a statistics cheat sheet for quick reference can always come in handy.
Think of this statistics cheat sheet as a reference when you need to quickly sanity-check your approach. We’ve tried to cover the key statistical concepts you’ll use most often.
1. Descriptive Statistics Fundamentals
Before diving into complex analyses or building sophisticated models, you need to understand what your data is telling you.
Descriptive statistics help you spot outliers, understand distributions, and get that initial feel for your dataset that guides all further analysis.
Central tendency measures tell you where your data clusters:
- Mean: The average value, highly sensitive to outliers
- Median: The middle value, more robust to outliers
- Mode: Most frequent value, especially useful for categorical data
Spread measures show how your data varies:
- Standard Deviation (σ): Square root of variance, showing typical distance from the mean
- Variance (σ²): Average squared deviation from mean
- IQR (Interquartile Range): Difference between 75th and 25th percentiles
- Range: maximum(data) – minimum(data)
2. Probability Distributions
Understanding probability distributions is a lot like having a roadmap of your data’s behavior. When you know which distribution your data follows, you can use the right statistical techniques and can make better predictions.
Also, some machine learning algorithms assume specific distributions – knowing these helps you avoid common modeling pitfalls.
Key probability distributions you’ll use:
- Normal Distribution: Bell-shaped curve, defined by the mean and standard deviation. Most natural phenomena follow this distribution
- Poisson Distribution: Models rare events
- Binomial Distribution: Models success/failure scenarios over fixed trials. Specifically, the number of successes in n independent Bernoulli trials
- Exponential Distribution: Continuous distribution that models time between events (waiting times
3. Hypothesis Testing
Every A/B test, every model validation, and every conclusion you draw from data relies on solid hypothesis testing. This is how we move from “I think” to “I know” in statistical analysis. It’s your toolkit for making decisions and validating your conclusions.
When comparing groups or testing assumptions:
Null Hypothesis (H₀): Default assumption (usually “no difference” or “no effect”)
Alternative Hypothesis (H₁): What you are trying to prove
Common tests:
- t-test: Comparing means between groups
- Chi-square: Testing categorical variable relationships
- ANOVA: Comparing means across multiple groups
- Kolmogorov-Smirnov: Testing if data follows a distribution
Important values:
- p-value < 0.05: Traditional significance threshold
- α (alpha): Your chosen significance level
- β (beta): The probability of Type II error
- Power (1-β): The probability of correctly rejecting the false null hypothesis
And here are things you should know about sampling and estimation.
Confidence intervals:
- 95% CI = x̄ ± (1.96 × SE)
- SE (Standard Error) = σ/√n
- Wider intervals mean less precision
Sampling methods:
- Simple Random: Each item has equal chance
- Stratified: Sampling within subgroups
- Cluster: Sampling groups rather than individuals
- Systematic: Every nth item
4. Correlation and Regression
Relationships between variables are important in almost all real-world datasets you work with. Whether you’re building predictive models or investigating causal relationships, understanding correlation and regression is essential.
These concepts will come in handy, be it simple linear models to complex machine learning algorithms.
Correlation coefficients:
- Pearson’s r: Linear correlation (-1 to 1)
- Spearman’s ρ: Rank correlation (more robust to outliers than Pearson’s
- Kendall’s τ: Another rank correlation, good for small samples
Regression types:
- Linear regression: Simple model with one independent variable
- Multiple linear regression: Multiple independent variables
- Logistic regression: For binary outcomes
- Polynomial regression: For more complex relationships
Key regression metrics:
- R²: Proportion of variance explained
- Adjusted R²: This is R² adjusted for number of predictors (model complexity)
- MSE/RMSE: Error metrics
- MAE: Mean Absolute Error (more robust to outliers than MSE)
5. Common Pitfalls to Watch Out For
Even experienced data professionals can fall into statistical traps. These aren’t just theoretical concerns – they’re real issues that can lead to incorrect conclusions and costly mistakes. Understanding these pitfalls helps you build more robust analyses and catch problems before they affect your decisions.
- Simpson’s Paradox: Trends in groups reverse when combined
- Multiple Testing Problem: More tests increase false positive chance
- Selection Bias: Sample not representative of population
- Survivorship Bias: Only analyzing “survivors”
- Confounding Variables: Hidden factors affecting relationships
6. For Quick Decisions
When choosing statistical tests, consider:
- Data type (continuous, categorical, ordinal)
- Sample size (n < 30 use non-parametric)
- Distribution shape (normal vs skewed)
- Number of groups/variables
- Independence of observations
Wrapping Up
While this guide covers the essentials, remember that your experience and domain knowledge are just as necessary as any statistical test.
When in doubt, return to the fundamentals:
- What question are you really trying to answer?
- Does your data actually support the analysis you want to do?
- And perhaps most importantly, how will your insights drive real decisions?
Keep this reference handy for when you need a quick refresher, but always work on learning and revising your stats skills.
Cover image created by the author | Segmind SSD-1B Model
