Topics / ai-models
AI models
How neural networks learn from data and get shaped into assistants, and the architectures that turn text, images and sound into predictions.
- How a neural network learns, from loss to all-reduce, 9 levels · 45 min · Idea to Silicon
- From base model to assistant: post-training, 9 levels · 40 min · Idea to Machine
- Mixture of experts, from router to all-to-all, 8 levels · 42 min · Idea to Silicon
- Vision models, from pixels to an answer, 9 levels · 38 min · Idea to Machine
- How a speech model hears, 9 levels · 38 min · Idea to Machine
- Diffusion models, from noise to an image, 9 levels · 42 min · Idea to Machine
The path
Read in this order and each dive leans on the ones before it. Every dive also stands on its own.
- 01
How a neural network learns, from loss to all-reduce
Turn prediction errors into gradients, build a tiny autograd engine, and train a real network in your browser. Then follow one weight update through optimizer memory, GPU collectives, pipeline schedules and the compute budget of a language model.
Idea to Silicon45 min9 levels
- 02
From base model to assistant: post-training
Follow one coding request through chat templates, supervised fine-tuning, preference learning and reinforcement learning, down to the log-probabilities and memory that make it work.
Idea to Machine40 min9 levels
- 03
Mixture of experts, from router to all-to-all
Follow a token into a sparse expert layer: router scores, balance and capacity, expert parallelism, token permutation, and the memory traffic behind conditional computation.
Idea to Silicon42 min8 levels
- 04
Vision models, from pixels to an answer
A receipt says $12.50. Follow its pixels through tensors, patches, attention and a language model to see how an image becomes evidence for an answer.
Idea to Machine38 min9 levels
- 05
How a speech model hears
Say “We see a cat.” Follow the air pressure through samples, Fourier transforms, mel filters and a Whisper decoder, all the way to the bytes and arithmetic that turn sound into text.
Idea to Machine38 min9 levels
- 06
Diffusion models, from noise to an image
Turn noise into structure with a real diffusion sampler, then follow an image through denoising, guidance, latent patches and the GPU arithmetic behind every step.
Idea to Machine42 min9 levels
Notes
Practical answers in ai models.
Transcribe audio locally with word timestamps
Use faster-whisper with word_timestamps and VAD, consume its segment generator, and preserve source-time offsets. Choose model size and compute type for your machine.
Other topics
AI serving
What it takes to run a model once it is trained: generating tokens fast, fitting weights into memory, coping with long prompts, and connecting models to data and tools.
6 dives · 8 notes · 4.8 h of reading
Web and networking
Everything between a URL and a pixel: the protocols that carry bytes across the internet and keep them private and fresh, and the browser machinery that turns them into a page.
12 dives · 10 notes · 8.8 h of reading
Systems and hardware
The machine under all the software: how a processor executes instructions, what memory really is, and how a GPU keeps thousands of threads busy.
6 dives · 4 notes · 4.6 h of reading
Languages and runtimes
The work a language runtime does on your behalf: scheduling goroutines, collecting garbage, and running portable bytecode safely and fast.
6 dives · 5 notes · 4.5 h of reading
Infrastructure and operations
Deploying and operating software: Kubernetes workloads, Helm releases, Ansible automation, Raspberry Pi clusters and the practical checks that keep systems running.
6 notes · 0.3 h of reading
Application development
Building applications and data workflows: framework patterns, Django and Wagtail models, Next.js integration, identity schemas and practical data scripts.
5 notes · 0.2 h of reading