Transformer Explainer · CLIP · Contrastive dual encoder

TRANSFORMER EXPLAINER

Click the prompt to edit · Recorded Granite MoE · trace JSON ↓ · Local Granite: connect on Generate · Enter generates; Shift+Enter inserts a line break. Up to 32 tokens.

Temperature

1

Sampling

Top-k Top-p

p=1

Dense MoE MLA Local–global Looped Encoder-only Encoder–decoder Speech Mamba hybrid Linear attention Vision–language ViT CLIP SAM DiT Diffusion LM Protein Time series Training Speculative

Zero-shot answer for I1 Loading… Both encoders · all 12 blocks and every head recorded · image encoder bidirectional, text encoder causal

Loading recorded inference…