Transformer Explainer · Speculative decoding · Qwen2.5

TRANSFORMER EXPLAINER

Click the prompt to edit · Recorded Granite MoE · trace JSON ↓ · Local Granite: connect on Generate · Enter generates; Shift+Enter inserts a line break. Up to 32 tokens.

Temperature

1

Sampling

Top-k Top-p

p=1

Dense MoE MLA Local–global Looped Encoder-only Encoder–decoder Speech Mamba hybrid Linear attention Vision–language ViT CLIP SAM DiT Diffusion LM Protein Time series Training Speculative

Greedy answer Loading… Qwen2.5-0.5B-Instruct drafts 4 tokens · Qwen2.5-1.5B-Instruct verifies · both recorded with their KV caches

Loading recorded inference…