Transformer Explainer · ESM-2 · Protein language model

TRANSFORMER EXPLAINER

Click the prompt to edit · Recorded Granite MoE · trace JSON ↓ · Local Granite: connect on Generate · Enter generates; Shift+Enter inserts a line break. Up to 32 tokens.

Temperature

1

Sampling

Top-k Top-p

p=1

Dense MoE MLA Local–global Looped Encoder-only Encoder–decoder Speech Mamba hybrid Linear attention Vision–language ViT CLIP SAM DiT Diffusion LM Protein Time series Training Speculative

All 12 blocks and 20 heads recorded · bidirectional · no structure given to the model

Loading recorded inference…