Jake Notes¶
Personal notes on mathematics stuff and deep learning bits.
-
Probability & Bayesian Inference
Beta-binomial distributions, hypergeometric sampling, and conjugate priors for ballot counting.
-
Linear Models & ANOVA
OLS derivation, ANOVA F-test geometry, R² as squared correlation, and projection-based proofs.
-
Universal Algebra
Operational types, free structures, algebraic theories, and equational reasoning from Johnstone's notes.
-
Attention Mechanisms
Self-attention, positional encoding, compatibility functions, and multi-head attention in transformers.
-
CLIP & SigLIP Losses
Contrastive learning losses: softmax-based CLIP (InfoNCE) vs sigmoid-based SigLIP with learned bias.