• Home
  • About
  • Writings
  • Teaching
    • Partial Differential Equations
  • Probabilistic Machine Learning
  • SigAlg
Categories
All (3)
Entropy (2)
Gaussian mixture models (1)
Information theory (2)
KL divergence (1)
Machine learning (1)
Measure theory (1)
Mixture models (1)
Mutual information (2)
Probabilistic graphical models (1)
Probability theory (3)
Python (2)
R (1)
SciPy (1)
Sigma-algebras (1)
Surprisal (1)

Algebras & information

Information theory
Probability theory
Measure theory
Entropy
Mutual information
Sigma-algebras
R
How do we mathematically represent what someone knows? This question sits at the heart of probability theory, information theory, and decision-making under uncertainty. When…
Oct 14, 2025

Entropy & information

Information theory
Probability theory
Entropy
Surprisal
KL divergence
Mutual information
Python
SciPy
Large language models (LLMs) like ChatGPT have brought probabilistic models into mainstream conversation. Unlike deterministic models that always produce the same output for…
Oct 12, 2025

Gaussian mixture models I: a first look

Mixture models
Gaussian mixture models
Probabilistic graphical models
Machine learning
Probability theory
Python
A mixture of gaussians represents one of the most elegant and practically useful concepts in probability theory and machine learning. At its core, this is a probabilistic…
Sep 26, 2025
No matching items