Playground

Interactive explorers for building intuition on ML systems. Move the dials and watch the tradeoffs.

RAG Pipeline

intermediate

Move the dials — chunk size, top-k, reranking, hybrid search — and watch retrieval quality and latency shift.

Retrieval-Augmented Generation

Distributed Training: Device Mesh

advanced

Shard a model across GPUs with tensor, pipeline, and data parallelism plus ZeRO — compare illustrative state-memory estimates.

Distributed Training & Parallelism

Bias–Variance Tradeoff

beginner

Fit one model to many random samples and watch the fits scatter (variance) and drift from truth (bias) as complexity, data, and noise change.

ML Fundamentals

Bandits: Explore vs Exploit

beginner

Play four arms with greedy, ε-greedy, and UCB on the same reward draws — and watch which strategies keep cumulative regret low.

Reinforcement Learning Basics

GRPO: Group-Relative Advantage

advanced

Score a group of responses and watch GRPO turn rewards into advantages using the group's own mean as the baseline — no critic, and it collapses when rewards agree.

Reinforcement Learning BasicsRLHF & Alignment

PPO: The Clipped Surrogate

advanced

Drag the importance ratio and flip the advantage's sign to see how PPO clipping saturates part of the surrogate objective; it does not enforce a hard ratio or KL bound.

Reinforcement Learning Basics

Self-Attention: the QKᵀ Softmax

intermediate

Pick a query token and inspect softmax(QKᵀ/√d_k). Adjust temperature to compare concentrated and spread-out attention, or mask future tokens for autoregression.

Transformers & Attention

Attention Complexity: the O(n²) Wall

intermediate

Compare modeled attention links, score storage and score-matmul work as a sequence grows. See how fixed windows and sparse patterns change the scaling.

Transformers & Attention

RoPE: Rotary Position Embeddings

advanced

Hold query and key content fixed, then rotate them with position. See why their RoPE dot product depends on the relative position gap.

Transformers & Attention

KV Cache: the Serving Bottleneck

advanced

Estimate weight and KV-cache storage for a model preset. Compare hypothetical MHA, GQA, MQA and MLA layouts, context lengths and cache precisions.

Model Serving & Inference Optimization

MoE Routing: Load Balancing & Collapse

advanced

Try synthetic routing patterns and inspect expert load, capacity and dropped routes. Compare top-k choices and an illustrative balancing adjustment.

Mixture of Experts

MCP: a Protocol Session, Step by Step

intermediate

Walk one Model Context Protocol session — connect, negotiate, discover tools, call one, feed the result back — and see how a poisoned tool description or an over-broad permission changes the outcome.

Agentic AI