An EAGLE drafter runs on four AMD V80 cards on box1 (an attention pair and an MLP/vocabulary pair, two cards each) and proposes a tree of tokens at once; an H200 checks the tree against the target model in one step. One FPGA image serves two targets, switched at runtime: Llama-3.2-3B and Qwen3.8-27B. Chat with it below and watch the bursts.
The attention pair splits the drafter's heads across two cards (12 Qwen heads or 16 Llama heads each), with low-bit weights held in on-chip memory and the prompt's keys and values imported from the GPU.
The second pair finishes the layer, scores the vocabulary and grows the draft tree. The four cards pass partial sums over direct QSFP links.
The GPU runs the target (Llama-3.2-3B or Qwen3.8-27B) once over the whole tree and keeps the longest correct branch. The output is exactly what the GPU alone would write.