Transformer Explainer · T5 · Encoder–decoder

TRANSFORMER EXPLAINER

Click the prompt to edit · Recorded Granite MoE · trace JSON ↓ · Local Granite: connect on Generate · Enter generates; Shift+Enter inserts a line break. Up to 32 tokens.

Temperature

1

Sampling

Top-k Top-p

p=1

Dense MoE MLA Local–global Looped Encoder-only Encoder–decoder Speech Mamba hybrid Linear attention Vision–language ViT CLIP SAM DiT Diffusion LM Protein Time series Training Speculative

Full model translation Loading… Block 1 of 6 in each stack · all 8 heads · bidirectional encoder, causal decoder

Loading recorded inference…