Probability, Statistics and Data

Uncertainty analysis, regression, probability distributions, correlation, and experimental noise.

General idea of the topic

Probability and statistics are indispensable for modeling experimental measurement uncertainty, thermodynamic ensembles (102310^{23} particles), and the fundamentally probabilistic foundation of quantum mechanics (Born's rule). They provide mathematical frameworks to infer physical invariants from finite sample datasets and distinguish true physical signals from random noise fluctuations.

This node covers discrete and continuous random variables, Probability Density Functions (PDF), canonical distributions (Binomial, Poisson, Gaussian, Maxwell-Boltzmann), the Central Limit Theorem, covariance, and error propagation.

What you will truly understand

You will understand the Central Limit Theorem: the sum of NN independent, identically distributed random variables with finite variance asymptotically converges to a Gaussian distribution, explaining why experimental noise in physics is universally normal.

You will compute expectation values ⟨x⟩=∫xP(x)dx\langle x \rangle = \int x P(x) dx, second-order variance moments σ2=⟨x2⟩−⟨x⟩2\sigma^2 = \langle x^2 \rangle - \langle x \rangle^2, and covariance matrices for correlated experimental observables.

Recommended learning route

  1. Probability foundations: Kolmogorov axioms, conditional probability, Bayes' theorem, and statistical independence.
  2. Random variables and canonical distributions: CDFs, PDFs, Poisson counting statistics, Gaussian distributions, and Maxwell-Boltzmann speeds.
  3. Central Limit Theorem and sampling: sample mean variance, standard error of the mean σ/N\sigma / \sqrt{N}, and the Law of Large Numbers.
  4. Statistical inference and regression: Maximum Likelihood Estimation (MLE), least-squares parameter fitting, and hypothesis testing (pp-values, confidence intervals).

Physical criterion you must acquire

Recognizing that in quantum mechanics, the probability density ∣ψ(x)∣2|\psi(x)|^2 reflects an irreducible, intrinsic ontological property of quantum states rather than classical subjective ignorance.

Connection with real problems

  • Discovery thresholds in high-energy particle physics (CERN 5σ5\sigma statistical significance, p<3×10−7p < 3 \times 10^{-7}).
  • Kinetic theory derivation of Maxwell-Boltzmann molecular speed distributions in ideal gases.
  • Shot noise limits in quantum optical detectors caused by quantized photon arrivals.

Final goal of the topic

Master probability theory, statistical distributions, and quantitative data inference for quantum mechanics, statistical mechanics, and experimental physics.

Topics in this section

  • Mean, Dispersion and Uncertainty

    Central tendency measures, variance, standard deviation, and experimental uncertainty quantification.

  • Error Propagation

    Differential error propagation rules for systematic and random uncertainties in derived physical quantities.

  • Basic Probability Distributions

    Fundamental probability distributions in physics: Gaussian normal, Poisson, binomial, and exponential models.

  • Data Fitting and Regression

    Least-squares data fitting, linear and nonlinear regression to extract physical parameters from measurements.

  • Correlation and Causality

    Statistical correlation coefficients, covariance, and rigorous distinction from physical causal mechanisms.

  • Noise and Basic Filtering

    Experimental noise models, signal-to-noise ratio, moving averages, and introductory low-pass filtering.