Transformer Explainer · Zamba2 · Transformer–Mamba

TRANSFORMER EXPLAINER

Click the prompt to edit · Recorded Granite MoE · trace JSON ↓ · Local Granite: connect on Generate · Enter generates; Shift+Enter inserts a line break. Up to 32 tokens.

Temperature

1

Sampling

Top-k Top-p

p=1

Dense MoE MLA Local–global Looped Encoder-only Encoder–decoder Speech Mamba hybrid Linear attention Vision–language ViT CLIP SAM DiT Diffusion LM Protein Time series Training Speculative

All 38 blocks

Purple: shared transformer, then Mamba · other blocks: Mamba

Loading recorded inference…