Notes from someone still learning.
Field notes on AI, machine learning, and whatever I'm trying to understand this week, sorted into boxes so the ideas stay caught.
-
Math Foundations
Vectors, gradients, and the loss functions under it all.
-
Precision & Quantization
Floats, quantization, and FP8 training that does not blow up.
-
GPUs & Hardware
What the silicon, memory, and network are actually doing.
-
Training Systems
Autograd, scaling laws, data pipelines, the loop itself.
-
Clusters & Reliability
Schedulers, collectives, checkpoints, staying up at scale.
-
Transformers & Inference
Attention architectures and the systems that serve them.
-
Evaluation
Measuring whether any of it actually works.
-
Post-Training & Alignment
RLHF, DPO, and GRPO: the reward models and rollout loops that turn a base model into a product.