EAGLE4 drafter pair · box1 silicon lab

Tested Images — 2026-09-26

as of 19:53 EDT · covers 2026-09-24 → 2026-09-26

Every HEAD + TAIL image pair that ran on the two V80 cards, with its features, code, build and test scripts, and every sweep cell (bench × width × depth × unprimed / primed / KVI). Numbers are measured; tok/s and accept come from the lab's run history, rebuilt from the box1 arm logs at 19:53 EDT. Full text catalog: /shared/rnd_hq/2026-09-26/TESTED_IMAGES_20260926.md.

Headline

pairfirst siliconmt w2 d2mt w3 d2best decided (lab)best cell in historyconfig of best cell
E1+CF2026-09-24178.16 @ 1.83 · n=3175.90 @ 1.97 · n=3178.16 @ 1.83
mt w2 d2 unprimed, SGLang 0.5.14, 3 rounds · width_ab_20260924_223134.txt (E1_W23_AB)
178.16 @ 1.83mt_bench w2 d2 unprimed, FASTGLUE off, SGLang 0.5.14, n=3
E3+CF2026-09-25175.39 @ 1.83 · n=4180.74 @ 1.97 · n=3180.74 @ 1.97
mt w3 d2 unprimed, SGLang 0.5.14, 3 rounds · width_ab_20260925_022343.txt (E3_FLASH/REPORT.md)
180.74 @ 1.97mt_bench w3 d2 unprimed, FASTGLUE off, SGLang 0.5.14, n=3
E7+F32026-09-26190.75 @ 1.83 · n=4188.50 @ 1.97 · n=3191.52 @ 1.83
mt w2 d2 unprimed, SGLang 0.5.14, 3 rounds · width_ab_20260926_122111.txt (E7F3_FLASH/REPORT.md)
190.75 @ 1.83mt_bench w2 d2 unprimed, FASTGLUE off, SGLang 0.5.14, n=4
C7+F42026-09-26177.84 @ 1.83 · n=3181.13 @ 1.98 · n=3181.13 @ 1.98
mt w3 d2 unprimed, SGLang 0.5.14, 3 rounds · width_ab_20260926_140347.txt (C7F4_FLASH/REPORT.md)
181.13 @ 1.98mt_bench w3 d2 unprimed, FASTGLUE off, SGLang 0.5.14, n=3
A8+F42026-09-26188.91 @ 1.83 · n=9187.87 @ 1.98 · n=7234.62 @ 2.55
mt w2 d2 KVI + FASTGLUE=4 (v4), SGLang 0.5.16, 3 rounds; v4.3 re-run 233.87 · HOST_GLUE_V4_FIXED/FASTGLUE_AB_SUMMARY.txt; HOST_GLUE_V43/REPORT.md
233.73 @ 2.55mt_bench w2 d2 KVI, FASTGLUE v4, SGLang 0.5.16, n=7
A5+F42026-09-26202.51 @ 1.83 · n=4201.81 @ 1.98 · n=4268.01 @ 2.55
mt w2 d2 KVI + FASTGLUE=4 (v4.2), SGLang 0.5.16, ONE round (not yet a decided A/B) · width_ab_20260926_185929.txt (ADAPTIVE_TREE/REPORT.md)
268.01 @ 2.55mt_bench w2 d2 KVI, FASTGLUE v4, SGLang 0.5.16, n=1

mt d2 columns: unprimed, KVI off, FASTGLUE off, SGLang 0.5.14, 50×32, mean of every plain arm (n). Units: tok/s @ mean accept length.

Timeline

  1. 09-24first silicon
    Baseline pair (reference texts for every later pair)
    HEADE1 SEAM_WIDE = 1KVONLY_SKIP_ATTN = 1
    TAILCF TREE_WIDTH_MAX = 8TREE_WIDTH runtime reg 0x1CC
    best 178.16 tok/s @ 1.83 — mt_bench w2 d2 unprimed, FASTGLUE off
  2. 09-25first silicon
    E1 + ATTN_PIPE
    HEADE3 ATTN_PIPE = 1ATTN_CSA_PAR = 6
    TAILCF unchanged
    best 180.74 tok/s @ 1.97 — mt_bench w3 d2 unprimed, FASTGLUE off
  3. 09-26first silicon
    256-lane HEAD + faster TAIL
    HEADE7 LANES_V = 256
    TAILF3 G12_OUTST3 = 1S1_OVERLAP = 0G1_LMDOWN_LANES_V = 64PIPE_CUT_SILU_V = 0 parameter added, built at 0
    best 190.75 tok/s @ 1.83 — mt_bench w2 d2 unprimed, FASTGLUE off
  4. 09-26first silicon
    KVI v2 HEAD (128 lanes) + G12X TAIL
    HEADC7 KVI_EN = 1KVI_WIDE = 1CHILD_ROPE_FIX = 1
    TAILF4 G12X_LANES_V = 64TREE_P = 32
    best 181.13 tok/s @ 1.98 — mt_bench w3 d2 unprimed, FASTGLUE off
  5. 09-26first silicon
    KVI v2 + 256 lanes; KVI, FASTGLUE and backend levers
    HEADA8 KVI_EN = 1KVI_WIDE = 1CHILD_ROPE_FIX = 1LANES_V = 256A8_TIMING_GUARD=1 build flow
    TAILF4 unchanged
    best 233.73 tok/s @ 2.55 — mt_bench w2 d2 KVI, FASTGLUE v4
  6. 09-26first silicon
    A5+F4 testing now
    Embedding fold + burst export: fold off (protocol, ADAPTIVE_TREE, KVI) then fold on
    HEADA5 G4_EMBFOLD = 1G4_EMBFOLD_NPC = 9SEAM_WIDE = 2
    TAILF4 unchanged
    best 268.01 tok/s @ 2.55 — mt_bench w2 d2 KVI, FASTGLUE v4

Images

Features are cumulative; filled chips are what the image adds over the previously tested image of its line (F3 includes the never-flashed F1, A8 includes C5, A5 includes A3). Hover a chip for the exact strap text. WNS/WHS are post-route, ns.

E1HEAD0xE4B711E1
md5 7b02c367WNS +0.001WHS +0.010
PIPE_ROLE = 2'd1PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 0FR_KF_BANKS = 16FR_ABANK_BRAM = 1DUAL_PORT = 1KV_RES_CLR_REP = 1DBG_CAP_EN_V = 0EAGLE4_OBS_LVL_P = 0DERATE_MHZ 66redesign_t0w2_kvonly_head sourceLANES_V = 128HEAD_PAR = 8ARRAY_FAST_CLK = 1SEAM_WIDE = 1KVONLY_SKIP_ATTN = 1
parent
CD 0xE4B711CD
code
asgard: /shared/build/gE1_headlever/verilog_43a8661/forks/head_seam256_kvskip_20260924 (EXPORT_MD5_LIST.txt, 317 files); box1: box1:~/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/verilog/forks/head_seam256_kvskip_20260924; README: reports/results/HEAD_SEAM256_KVSKIP_20260924.md (repo)
commit
43a8661 (toggles added in 0220bf7; 43a8661 regenerates pkg_param_list.tcl)
build
/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/scripts/uni_pipeline_headlever_asgard.sh (md5 7fcd35cc; staged strap loop line 796)
wrapper
/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/scripts/run_headlever_0xE4B711E1_asgard.sh (plain; no vmpar2 variant existed; used per /shared/build/gE1_headlever/launch_asgard_4.log)
host
asgard (mesh class pdi_build_asgard_e1, rc=0 2026-09-24 14:21)
host patch
none new: E1/E3 already in oneflip_relay_driver KVONLY_HEAD_BUILDS (CONTEXT_DIGEST_20260924.md §8); LANES 128: no lane table entry needed
timing src
source: /shared/build/gE1_headlever/aved_oneflip_p2s_head_asgard/hw/amd_v80_gen5x8_25.1_pdi23/build/prj.runs/impl_1/post_route_phys_opt_report_timing_summary_0.rpt; 0 failing of 2,585,701 endpoints per box1 ADJUDICATION_20260924.txt
PDI
asgard ~/eagle4_artifacts/uni_oneflip/oneflip_p2s_head_asgard_0xE4B711E1_66m_7b02c367.pdi (clone: /shared/build/gE1_headlever/aved_oneflip_p2s_head_asgard/hw/amd_v80_gen5x8_25.1_pdi23/amd_v80_gen5x8_25.1.pdi); box1:~/eagle4_artifacts/uni_oneflip/same name
tested
E1+CF
best
178.16 tok/s @ 1.83 on E1+CF (mt_bench w2 d2 unprimed, FASTGLUE off)
CFTAIL0xE4B711CF
md5 3e3bc79aWNS +0.015WHS +0.011
PIPE_ROLE = 2'd2PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 1DERATE_MHZ 66attention + RoPE pruned on TAILTISEQ = 1TREE_P = 16SER_DEPTH = 16384TILE_PIPE = 1TREE_PP = 1TREE_WIDTH_MAX = 8TREE_WIDTH runtime reg 0x1CC
parent
CB 0xE4B711CB
code
asgard: /shared/build/tCF_width/verilog_ef36d00/forks/tree_width_tail_20260924 (staging for the withdrawn asgard copy; same md5 list); box1: box1:~/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/verilog/forks/tree_width_tail_20260924; README: reports/results/TREE_WIDTH_PAIR_20260924.md (repo)
commit
ef36d00
build
/shared/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/scripts/uni_pipeline_tree_width_tail_olegvm_slot3.sh (md5 033ac7ea) (inferred from _hostwide_slot3 in GATE_VERDICTS + 'VM slot-3 copy was already routing')
wrapper
—
host
olegvm slot 3 (clone ~/alt_build_20260922/tCF_width; heavy lock _hostwide_slot3)
host patch
PAIR_TREE_WIDTH host flag (scripts/pair_tree_width.py, arm_tail_width writes 0x1CC before each tree root; host commit 92f4e0be) for width < 8; width 8 needs nothing
timing src
source: /shared/rnd_hq/hq_daily/images.csv; VM route report not harvested to asgard
PDI
box1:~/eagle4_artifacts/uni_oneflip/oneflip_p2s_tail_olegvm_0xE4B711CF_66m_3e3bc79a.pdi (olegvm ~/eagle4_artifacts/uni_oneflip/ same name, not read)
tested
E1+CF, E3+CF
best
180.74 tok/s @ 1.97 on E3+CF (mt_bench w3 d2 unprimed, FASTGLUE off)
E3HEAD0xE4B711E3
md5 809219eaWNS +0.002WHS +0.010
PIPE_ROLE = 2'd1PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 0FR_KF_BANKS = 16FR_ABANK_BRAM = 1DUAL_PORT = 1KV_RES_CLR_REP = 1DBG_CAP_EN_V = 0EAGLE4_OBS_LVL_P = 0DERATE_MHZ 66redesign_t0w2_kvonly_head sourceLANES_V = 128HEAD_PAR = 8ARRAY_FAST_CLK = 1SEAM_WIDE = 1KVONLY_SKIP_ATTN = 1ATTN_PIPE = 1ATTN_CSA_PAR = 6
parent
E1 0xE4B711E1
code
olegvm: ~/alt_build_20260922/gE3_attnpipe/verilog_ecddc77/forks/attn_pipe_ce_20260924 (EXPORT_MD5_LIST.txt, 320 files); box1: box1:~/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/verilog/forks/attn_pipe_ce_20260924; README: reports/results/LEVEL_BATCHED_HEAD_20260924.md §9-10 (repo)
commit
ecddc77
build
/shared/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/scripts/uni_pipeline_attnpipe_e3_olegvm.sh (md5 11ec767f; strap loop line 799, XCI want ATTN_CSA_PAR 6 line 1561)
wrapper
/shared/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/scripts/run_attnpipe_0xE4B711E3_olegvm.sh (plain; launched detached on the VM, not via mesh)
host
olegvm slot 3 (clone ~/alt_build_20260922/gE3_attnpipe)
host patch
none new: E3 already in KVONLY_HEAD_BUILDS (CONTEXT_DIGEST_20260924.md §8)
timing src
source: box1:~/eagle4_artifacts/uni_oneflip/oneflip_p2s_head_olegvm_0xE4B711E3_66m_809219ea.ADJUDICATION_20260925.txt, citing VM route_report_timing_summary_0.rpt; 0 failing of 2,588,052
PDI
box1:~/eagle4_artifacts/uni_oneflip/oneflip_p2s_head_olegvm_0xE4B711E3_66m_809219ea.pdi (VM source md5 identical)
tested
E3+CF
best
180.74 tok/s @ 1.97 on E3+CF (mt_bench w3 d2 unprimed, FASTGLUE off)
E7HEAD0xE4B711E7
md5 907f44eeWNS 0.000WHS +0.008
PIPE_ROLE = 2'd1PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 0FR_KF_BANKS = 16FR_ABANK_BRAM = 1DUAL_PORT = 1KV_RES_CLR_REP = 1DBG_CAP_EN_V = 0EAGLE4_OBS_LVL_P = 0DERATE_MHZ 66redesign_t0w2_kvonly_head sourceLANES_V = 256HEAD_PAR = 8ARRAY_FAST_CLK = 1SEAM_WIDE = 1KVONLY_SKIP_ATTN = 1
parent
E1 0xE4B711E1
code
note: fork head_seam256_lanes256_20260925 (eagle4_config.svh md5 f554da2b; only diff vs E1 = line 326 LANES_V 128->256). Not found on asgard (/shared/scratch, /shared/build) or box1 verilog/forks; sim copy of the source: /shared/scratch/l256_head/src_L256; README: /shared/scratch/l256_head/handoff_host/README_E7_HOST.md; /shared/scratch/l256_head/L256_HEAD_FLASH_GATE_20260924.md
commit
none (fork shipped as tarball/handoff dir, never committed; see code)
build
scripts/uni_pipeline_headlever_e7_olegvm.sh (md5 b088bb70; E2 pipeline with SEAM_WIDE 2->1 in 2 places) - exists only on olegvm; not found on asgard or box1
wrapper
olegvm ~/run_gE7_headlever256_seam1.sh (not on asgard/box1; plain, pre-vmpar2)
host
olegvm
host patch
L256 lane table: L256_HOST_PACKING.patch (LANES_BY_BUILD_ID {0xE4B711E7: 256} in eagle4_role_geometry.py + full_session_m7.py), later superseded by L256_HOST_PACKING_v3_E7_A6_A8_AA.patch; L256_RELAY_KVONLY.patch: add 0xE4B711E7 to KVONLY_HEAD_BUILDS (oneflip_relay_driver.py:2293, both $R and $W); box1 copies: /sanctuary/pdi_inbox/E7_HOST/
timing src
source: /shared/rnd_hq/2026-09-25/PDI_INBOX_NOTE_E7_20260925.md; 0 failing endpoints
PDI
box1:~/eagle4_artifacts/uni_oneflip/oneflip_p2s_head_olegvm_0xE4B711E7_66m_907f44ee.pdi; box1:/sanctuary/pdi_inbox/oneflip_p2s_head_olegvm_0xE4B711E7_66m_907f44ee.pdi
tested
E7+F3
best
190.75 tok/s @ 1.83 on E7+F3 (mt_bench w2 d2 unprimed, FASTGLUE off)
F3TAIL0xE4B711F3
md5 693a35daWNS +0.280WHS +0.010
PIPE_ROLE = 2'd2PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 1DERATE_MHZ 66attention + RoPE pruned on TAILTISEQ = 1TREE_P = 16SER_DEPTH = 16384TILE_PIPE = 1TREE_PP = 1TREE_WIDTH_MAX = 8TREE_WIDTH runtime reg 0x1CCG12_OUTST3 = 1S1_OVERLAP = 0G1_LMDOWN_LANES_V = 64PIPE_CUT_SILU_V = 0
parent
F1 0xE4B711F1 (never flashed; itself = CF 0xE4B711CF)
code
asgard: /shared/scratch/tail_levers2/tail_levers2_fork_work_20260924.tar.gz (md5 a0f314bb) = /shared/scratch/tail_levers2/fork_work; staged /shared/build/tF3_g1lanes64/verilog_a0f314bb_forks_tail_levers2_g1_20260925; box1: not present; README: /shared/scratch/tail_levers2/TAIL_CHILD_LEVERS2_20260924.md §5 Build A; /shared/rnd_hq/2026-09-25/PDI_INBOX_NOTE_F1_F3_20260925.md
commit
none (fork shipped as tarball/handoff dir, never committed; see code)
build
scripts/uni_pipeline_tail_consolidated_g1_asgard_slot2.sh (md5 ae3fdd17; asgard copy /shared/scratch/tail_levers2/f4_ref/uni_pipeline_tail_consolidated_g1_asgard_slot2.sh)
wrapper
/shared/scratch/tail_levers2/f4_ref/run_tF3_g1lanes64_olegvm2.sh (plain)
host
olegvm2 (slot tF3_g1lanes64, lock _hostwide_slot2)
host patch
none: host ABI unchanged vs CF (PDI_INBOX_NOTE_F1_F3)
timing src
source: /shared/rnd_hq/2026-09-25/PDI_INBOX_NOTE_F1_F3_20260925.md; 0 failing endpoints
PDI
box1:~/eagle4_artifacts/uni_oneflip/oneflip_p2s_tail_asgard_0xE4B711F3_66m_693a35da.pdi; box1:/sanctuary/pdi_inbox/same name
tested
E7+F3
best
190.75 tok/s @ 1.83 on E7+F3 (mt_bench w2 d2 unprimed, FASTGLUE off)
C7HEAD0xE4B711C7
md5 4e9014f6WNS +0.004WHS +0.010
PIPE_ROLE = 2'd1PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 0FR_KF_BANKS = 16FR_ABANK_BRAM = 1DUAL_PORT = 1KV_RES_CLR_REP = 1DBG_CAP_EN_V = 0EAGLE4_OBS_LVL_P = 0DERATE_MHZ 66redesign_t0w2_kvonly_head sourceLANES_V = 128HEAD_PAR = 8ARRAY_FAST_CLK = 1SEAM_WIDE = 1KVONLY_SKIP_ATTN = 1ATTN_PIPE = 1ATTN_CSA_PAR = 6KVI_EN = 1KVI_WIDE = 1CHILD_ROPE_FIX = 1
parent
E3 0xE4B711E3
code
asgard: /shared/scratch/kvi/forks_v2/handoff_v2/head_kvi2_e3_20260925.tar.gz (md5 a9ffcd46); staged /shared/build/kvi2_stage_c7/forks/head_kvi2_e3_20260925; box1: not present; README: /shared/scratch/kvi/forks_v2/handoff_v2/README_HANDOFF_V2.md; /shared/rnd_hq/2026-09-25/PDI_INBOX_NOTE_C7_20260925.md
commit
none (fork shipped as tarball/handoff dir, never committed; see code)
build
/shared/build/kvi2_stage_c7/uni_pipeline_kvi2_e3.sh (md5 b4b5100c = handoff /shared/scratch/kvi/forks_v2/handoff_v2/uni_pipeline_kvi2_e3.sh)
wrapper
/shared/build/kvi2_stage_c7/run_kvi2_0xE4B711C7.sh (plain, confirmed by /shared/build/kvi2_stage_c7/launch.log)
host
asgard (mesh class pdi_build_head_kvi2_asgard, rc=0 2026-09-25 15:44, peak 72.5 GB)
host patch
KVI host (KVI_HOST, flag EAGLE4_PAIR_KVI, HBM 0x42B0000000, CSRs 0x1E0..0x1F4); relay KVONLY build-id set: add 0xE4B711C7 to KVONLY_HEAD_BUILDS
timing src
source: /shared/build/gC7_kvi2/aved_oneflip_p2s_head_asgard/hw/amd_v80_gen5x8_25.1_pdi23/build/prj.runs/impl_1/post_route_phys_opt_report_timing_summary_0.rpt
PDI
asgard ~/eagle4_artifacts/uni_oneflip/oneflip_p2s_head_asgard_0xE4B711C7_66m_4e9014f6.pdi (clone /shared/build/gC7_kvi2/aved_oneflip_p2s_head_asgard/hw/amd_v80_gen5x8_25.1_pdi23/amd_v80_gen5x8_25.1.pdi); box1:~/eagle4_artifacts/uni_oneflip/same name; box1:/sanctuary/pdi_inbox/same name
tested
C7+F4
best
181.13 tok/s @ 1.98 on C7+F4 (mt_bench w3 d2 unprimed, FASTGLUE off)
F4TAIL0xE4B711F4
md5 85af2587WNS +0.054WHS +0.010
PIPE_ROLE = 2'd2PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 1DERATE_MHZ 66attention + RoPE pruned on TAILTISEQ = 1TREE_P = 32SER_DEPTH = 16384TILE_PIPE = 1TREE_PP = 1TREE_WIDTH_MAX = 8TREE_WIDTH runtime reg 0x1CCG12_OUTST3 = 1S1_OVERLAP = 0G1_LMDOWN_LANES_V = 64PIPE_CUT_SILU_V = 0G12X_LANES_V = 64
parent
F3 0xE4B711F3
code
asgard: /shared/scratch/tail_levers2/handoff_f4/fork_tail_levers2_g12x_20260925 (+ .tar.gz md5 db185ccc); box1: not present; README: /shared/scratch/tail_levers2/handoff_f4/HANDOFF_F4.md
commit
none (fork shipped as tarball/handoff dir, never committed; see code)
build
/shared/scratch/tail_levers2/handoff_f4/uni_pipeline_tail_g12x_f4_vmpar2_asgard.sh (md5 35c75e4a, wrapper default) or uni_pipeline_tail_g12x_f4_asgard.sh (md5 4dfc4475)
wrapper
/shared/scratch/tail_levers2/handoff_f4/run_tF4_kpar32_olegvm2.sh (uses _vmpar2 unless F4_PIPELINE overrides; which one actually ran: vmpar2 (inferred), no launch log on asgard)
host
olegvm2 (images.csv; slot tF4_kpar32)
host patch
none recorded in HANDOFF_F4.md (TAIL ABI unchanged) (inferred)
timing src
source: /shared/rnd_hq/2026-09-25/PDI_INBOX_NOTE_BATCH_20260926.md; 0 failing endpoints
PDI
box1:~/eagle4_artifacts/uni_oneflip/oneflip_p2s_tail_asgard_0xE4B711F4_66m_85af2587.pdi; box1:/sanctuary/pdi_inbox/same name
tested
C7+F4, A8+F4, A5+F4
best
268.01 tok/s @ 2.55 on A5+F4 (mt_bench w2 d2 KVI, FASTGLUE v4)
A8HEAD0xE4B711A8
md5 97e717edWNS +0.002WHS +0.010
PIPE_ROLE = 2'd1PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 0FR_KF_BANKS = 16FR_ABANK_BRAM = 1DUAL_PORT = 1KV_RES_CLR_REP = 1DBG_CAP_EN_V = 0EAGLE4_OBS_LVL_P = 0DERATE_MHZ 66redesign_t0w2_kvonly_head sourceLANES_V = 256HEAD_PAR = 8ARRAY_FAST_CLK = 1SEAM_WIDE = 1KVONLY_SKIP_ATTN = 1KVI_EN = 1KVI_WIDE = 1CHILD_ROPE_FIX = 1A8_TIMING_GUARD=1 build flow
parent
C5 0xE4B711C5 (never flashed; itself = E1 0xE4B711E1)
code
asgard: /shared/scratch/l256_head/handoff_a8/forks/head_kvi2_e1_l256_20260925 + MD5LIST_head_kvi2_e1_l256_20260925.txt; staged /shared/build/a8_stage/forks; box1: not present; README: /shared/scratch/l256_head/handoff_a8/README_A8.md
commit
none (fork shipped as tarball/handoff dir, never committed; see code)
build
/shared/build/a8_stage/uni_pipeline_a8_l256.sh (md5 0eb6e55e = /shared/scratch/l256_head/handoff_a8/uni_pipeline_a8_l256.sh)
wrapper
/shared/build/a8_stage/run_0xE4B711A8.sh (plain, confirmed by /shared/build/a8_stage/launch.log)
host
asgard (mesh class pdi_build_head_a8_l256, rc=0 2026-09-26 12:41)
host patch
L256 lane table: L256_HOST_PACKING_v3_E7_A6_A8_AA.patch (160a1380); relay KVONLY build-id set: RELAY_KVONLY_ALL_v3.patch (+ .W for $W); KVI host: KVI_HOST_v3.patch (KVI_HEAD_BUILDS += A8); box1 copies: /sanctuary/pdi_inbox/L256_HOST/
timing src
source: /shared/build/gA8_l256/aved_oneflip_p2s_head_asgard/hw/amd_v80_gen5x8_25.1_pdi23/build/prj.runs/impl_1/post_route_phys_opt_report_timing_summary_0.rpt
PDI
asgard ~/eagle4_artifacts/uni_oneflip/oneflip_p2s_head_asgard_0xE4B711A8_66m_97e717ed.pdi (clone /shared/build/gA8_l256/...); box1:~/eagle4_artifacts/uni_oneflip/same name; box1:/sanctuary/pdi_inbox/same name
tested
A8+F4
best
233.73 tok/s @ 2.55 on A8+F4 (mt_bench w2 d2 KVI, FASTGLUE v4)
A5HEAD0xE4B711A5
md5 1f934249WNS 0.000WHS +0.001
PIPE_ROLE = 2'd1PERSIST = 1DEPTH_N = 1EMBG_EN = 1FORREASON = 1G8_SPLICE = 0FR_KF_BANKS = 16FR_ABANK_BRAM = 1DUAL_PORT = 1KV_RES_CLR_REP = 1DBG_CAP_EN_V = 0EAGLE4_OBS_LVL_P = 0DERATE_MHZ 66redesign_t0w2_kvonly_head sourceLANES_V = 128HEAD_PAR = 8ARRAY_FAST_CLK = 1SEAM_WIDE = 2KVONLY_SKIP_ATTN = 1ATTN_PIPE = 1ATTN_CSA_PAR = 6KVI_EN = 1KVI_WIDE = 1CHILD_ROPE_FIX = 1G4_EMBFOLD = 1G4_EMBFOLD_NPC = 9
parent
A3 0xE4B711A3 (never flashed; itself = C7 0xE4B711C7)
code
asgard: /shared/scratch/embfold_c7/handoff_a5/head_embfold_c7_20260925.tar.gz (same fork as A3); staged /shared/build/embfold_stage_a5/forks; box1: not present; README: /shared/scratch/embfold_c7/handoff_a5/README_HANDOFF_A5.md
commit
none (fork shipped as tarball/handoff dir, never committed; see code)
build
/shared/build/embfold_stage_a5/uni_pipeline_embfold_a5_vmpar2.sh (md5 bac03801 = /shared/scratch/embfold_c7/handoff_a5/uni_pipeline_embfold_a5_vmpar2.sh)
wrapper
/shared/build/embfold_stage_a5/run_embfold_0xE4B711A5_vmpar2.sh (the _vmpar2 wrapper was used even though the host was asgard; confirmed by /shared/build/embfold_stage_a5/launch.log)
host
asgard (mesh class pdi_build_head_embfold_a5, rc=0 2026-09-25 20:51)
host patch
same as A3: EMBFOLD table upload + relay hook + .embfold relay/kvi_host (A5 in KVONLY_HEAD_BUILDS / KVI_HEAD_BUILDS); KVI host as C7; SEAM_WIDE 2 burst: host relay unchanged (per A2 handoff, PDI_INBOX_NOTE_BATCH)
timing src
source: /shared/build/gA5_stack/aved_oneflip_p2s_head_asgard/hw/amd_v80_gen5x8_25.1_pdi23/build/prj.runs/impl_1/post_route_phys_opt_report_timing_summary_0.rpt
PDI
asgard ~/eagle4_artifacts/uni_oneflip/oneflip_p2s_head_asgard_0xE4B711A5_66m_1f934249.pdi (clone /shared/build/gA5_stack/...); box1:~/eagle4_artifacts/uni_oneflip/same name; box1:/sanctuary/pdi_inbox/EMBFOLD/same name
tested
A5+F4
best
268.01 tok/s @ 2.55 on A5+F4 (mt_bench w2 d2 KVI, FASTGLUE v4)

Pairs: test runs and sweeps

E1+CF

HEAD E1 0xE4B711E1 + TAIL CF 0xE4B711CF

Baseline pair (reference texts for every later pair)

sessiondatetest scriptssettingsverdict
E1_ARM09-24pair_width_ab.sh—PASS; survivors identical to C8+CF
INDEX.csv
E1_W23_AB09-24pair_width_ab.sh (ORDER "2 3 3 2 2 3")SGLang 0.5.14; KVI no; FASTGLUE off; backend fa4; 6 armsw2 178.16 (+17.6%) w3 175.90 (+20.1%) vs C8; texts 50/50
INDEX.csv
E1_W809-24pair_width_ab.shSGLang 0.5.14; KVI no; FASTGLUE off; backend fa4; 3 armsw8 d2 140.50 @2.21 (+26.5% vs C8 111.05); texts 50/50
INDEX.csv
E1_PRIMED_D2309-24pair_width_ab.sh (ARM_ENV = PRIME_PREFIX/KVONLY/MD)—primed w3 d2 118.96@2.61 / d3 110.25@3.15; priming -32% vs unprimed
INDEX.csv
E1_DEPTH_SWEEP09-24/home/y344shi/.claude/jobs/5b98fbdb/tmp/depth_sweep_e1.sh
pair_width_ab.sh
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 12 armsmt w3 d3-15: unprimed accept flat 2.08-2.15; primed d15 4.68 = 103.5% of GPU
INDEX.csv
E1_TIME_BREAKDOWN09-24/home/y344shi/.claude/jobs/5b98fbdb/tmp/tb_e1_census.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/tb_e1_glue.sh
pair_census.sh
ab_glue.sh + gdecomp2.py
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off; backend fa4; 3 armscycle 15.78 ms = draft 8.54 + GPU verify 3.98 + glue 3.06; priming +4.7 ms HEAD (G4+G5)
INDEX.csv
E1_HUMANEVAL_W2309-24/home/y344shi/.claude/jobs/5b98fbdb/tmp/t5_hum_e1.sh
pair_width_ab.sh
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 4 armshum w2 120.72 @1.91; w3 119.51 @2.06; texts deterministic 50/50
INDEX.csv
E1_DEPTH_SWEEP_HUM09-24/home/y344shi/.claude/jobs/5b98fbdb/tmp/depth_sweep_e1_hum.sh
pair_width_ab.sh
sweep_table.py
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 12 armshum w3 d2-15: unprimed accept flat 2.38-2.40 from d5; primed 2.88->8.60; best unprimed d2 120.9
INDEX.csv
E1_HUM_VS_GPU_50x3209-24/sanctuary/lab/results/2026-09-24/E1_HUM_VS_GPU_50x32/gpu_hum50x32.sh
gpu_golden_cells.sh
—primed pair accept = 99-102% of GPU fa4 to d5; unprimed 32-71%; pair tok/s 15-50% of fa4
INDEX.csv
E1_R2_PRIMEROWS09-24/home/y344shi/.claude/jobs/5b98fbdb/tmp/r2_e1.sh
r_job.sh
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 7 armsPRIME_ROWS 16/64/full at w3 d7: accept 3.05/3.90/4.21 at 103.2/108.7/86.5 tok/s
INDEX.csv
E1_R2_PRIMEROWS_D1509-24/home/y344shi/.claude/jobs/5b98fbdb/tmp/r2d15_e1.sh
r_job.sh
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 4 armsPRIME_ROWS 16/64/128/full at w3 d15: tok/s 57.5/67.9/63.2/57.7 (64 rows fastest)
INDEX.csv
E1_D44909-24/home/y344shi/.claude/jobs/5b98fbdb/tmp/t6_d449_e1.sh
/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/.claude/worktrees/velvety-puzzling-blossom/scripts/run_test_b.sh
pair_depth_golden_run.py
—w8 d7 stale readback = host RACE (not a wedge)
INDEX.csv
KV_DETAIL09-25/home/y344shi/.claude/jobs/5b98fbdb/tmp/kv_detail_run.sh
kvd_part1_all.sh
ab_glue_w.sh
kvd_part1.py / kvd_part2.py
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 14 armsprimed accept dist = GPU fa4 (means +-3%); prime ~120 ms/req, ~80% host RTT
INDEX.csv
E1_R3B09-25/home/y344shi/.claude/jobs/5b98fbdb/tmp/r3b_e1.sh
r_job.sh
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 4 armsFAILED both arms: stale tree readback at 228 nodes (host race); NOT MEASURED
INDEX.csv
E1_R3B_RACEFIX09-25/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/.claude/worktrees/velvety-puzzling-blossom/scripts/tree_readback_racefix/lab_r3b_racefix.sh
r_job.sh
SGLang 0.5.16; KVI no; FASTGLUE off; backend fa4; 2 armshum w4 d15 80x1024: primed 71.47 @7.50 (92% of GPU fa4 8.15); unprimed 56.74 @4.25
INDEX.csv
E1_D449_RACEFIX09-25/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/.claude/worktrees/velvety-puzzling-blossom/scripts/tree_readback_racefix/lab_t6_racefix.sh—RACEFIX PASS (w8 d7, 392 nodes); overlap FAIL L4-L6 (deep-w8 finding)
INDEX.csv
E1_PEROP_XVAL09-25/home/y344shi/.claude/jobs/5b98fbdb/tmp/t8_perop_e1.sh
perop_xval_*.py
—rope_pos+1 child defect CONFIRMED sub-threshold (fixed later by CHILD_ROPE_FIX in C5/C7/A8)
INDEX.csv
E1_W8D7_SCORES09-25/home/y344shi/.claude/jobs/5b98fbdb/tmp/w8d7_scores.sh
/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/.claude/worktrees/velvety-puzzling-blossom/scripts/pair_depth_golden_run_scores.py
—392 nodes with Q12.20 scores; L4/L5 near-ties
INDEX.csv
tok/s vs depth (50×32; hover a point for accept, rounds and source)
0 50 100 150 200 2 3 4 5 6 7 8 10 15 tree depth d tok/s hum unprimed w3 d2: 119.98 tok/s @ 2.06 accept (n=3; width_ab_20260924_230441.txt width_ab_20260924_231612.txt) hum unprimed w3 d3: 105.12 tok/s @ 2.22 accept (n=1; width_ab_20260924_231612.txt) hum unprimed w3 d5: 85.52 tok/s @ 2.38 accept (n=1; width_ab_20260924_231612.txt) hum unprimed w3 d8: 64.55 tok/s @ 2.40 accept (n=1; width_ab_20260924_231612.txt) hum unprimed w3 d10: 55.05 tok/s @ 2.40 accept (n=1; width_ab_20260924_231612.txt) hum unprimed w3 d15: 40.20 tok/s @ 2.38 accept (n=1; width_ab_20260924_231612.txt) hum primed w3 d2: 78.65 tok/s @ 2.88 accept (n=1; width_ab_20260924_232332.txt) hum primed w3 d3: 78.20 tok/s @ 3.82 accept (n=1; width_ab_20260924_232332.txt) hum primed w3 d5: 72.89 tok/s @ 5.08 accept (n=1; width_ab_20260924_232332.txt) hum primed w3 d8: 69.71 tok/s @ 6.67 accept (n=1; width_ab_20260924_232332.txt) hum primed w3 d10: 67.84 tok/s @ 7.44 accept (n=1; width_ab_20260924_232332.txt) hum primed w3 d15: 61.13 tok/s @ 8.60 accept (n=1; width_ab_20260924_232332.txt) mt unprimed w3 d2: 175.90 tok/s @ 1.97 accept (n=3; width_ab_20260924_223134.txt) mt unprimed w3 d3: 142.22 tok/s @ 2.08 accept (n=1; width_ab_20260924_224558.txt) mt unprimed w3 d5: 102.85 tok/s @ 2.14 accept (n=1; width_ab_20260924_224558.txt) mt unprimed w3 d8: 71.33 tok/s @ 2.15 accept (n=1; width_ab_20260924_224558.txt) mt unprimed w3 d10: 58.56 tok/s @ 2.14 accept (n=1; width_ab_20260924_224558.txt) mt unprimed w3 d15: 41.39 tok/s @ 2.15 accept (n=1; width_ab_20260924_224558.txt) mt primed w3 d2: 118.57 tok/s @ 2.61 accept (n=3; width_ab_20260924_224150.txt width_ab_20260924_235301.txt) mt primed w3 d3: 110.52 tok/s @ 3.15 accept (n=3; width_ab_20260924_224150.txt width_ab_20260924_225205.txt width_ab_20260924_235301.txt) mt primed w3 d4: 104.75 tok/s @ 3.46 accept (n=1; width_ab_20260924_235301.txt) mt primed w3 d5: 97.00 tok/s @ 3.79 accept (n=2; width_ab_20260924_225205.txt width_ab_20260924_235301.txt) mt primed w3 d6: 91.27 tok/s @ 4.00 accept (n=1; width_ab_20260924_235301.txt) mt primed w3 d7: 86.28 tok/s @ 4.21 accept (n=2; width_ab_20260924_231439.txt width_ab_20260924_235301.txt) mt primed w3 d8: 83.65 tok/s @ 4.36 accept (n=1; width_ab_20260924_225205.txt) mt primed w3 d10: 73.78 tok/s @ 4.52 accept (n=1; width_ab_20260924_225205.txt) mt primed w3 d15: 57.70 tok/s @ 4.68 accept (n=2; width_ab_20260924_225205.txt width_ab_20260924_234352.txt) ■ hum primed w3 ■ mt primed w3 ■ mt unprimed w3 ■ hum unprimed w3
w × d grid — humaneval unprimed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d \ ww2w3
d2120.72@ 1.91 · n=2119.98@ 2.06 · n=3
d3—105.12@ 2.22 · n=1
d5—85.52@ 2.38 · n=1
d8—64.55@ 2.40 · n=1
d10—55.05@ 2.40 · n=1
d15—40.20@ 2.38 · n=1
source: width_ab_20260924_230441.txt, width_ab_20260924_231612.txt
Depth ladders and width rows
w3 · humaneval primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 78.65 @ 2.88 · n=1d3 78.20 @ 3.82 · n=1d5 72.89 @ 5.08 · n=1d8 69.71 @ 6.67 · n=1d10 67.84 @ 7.44 · n=1d15 61.13 @ 8.60 · n=1
source: width_ab_20260924_232332.txt
w3 · mt_bench primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 118.57 @ 2.61 · n=3d3 110.52 @ 3.15 · n=3d4 104.75 @ 3.46 · n=1d5 97.00 @ 3.79 · n=2d6 91.27 @ 4.00 · n=1d7 86.28 @ 4.21 · n=2d8 83.65 @ 4.36 · n=1d10 73.78 @ 4.52 · n=1d15 57.70 @ 4.68 · n=2
source: width_ab_20260924_224150.txt, width_ab_20260924_225205.txt, width_ab_20260924_231439.txt, width_ab_20260924_234352.txt, width_ab_20260924_235301.txt
w3 · mt_bench primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32, flags: TREE_PRIME_ROWS=16
d7 103.23 @ 3.05 · n=1d15 57.47 @ 3.16 · n=1
source: width_ab_20260924_231229.txt, width_ab_20260924_234003.txt
w3 · mt_bench primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32, flags: TREE_PRIME_ROWS=64
d7 108.67 @ 3.90 · n=1d15 67.90 @ 4.27 · n=1
source: width_ab_20260924_231335.txt, width_ab_20260924_234122.txt
w3 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d3 142.22 @ 2.08 · n=1d5 102.85 @ 2.14 · n=1d8 71.33 @ 2.15 · n=1d10 58.56 @ 2.14 · n=1d15 41.39 @ 2.15 · n=1
source: width_ab_20260924_224558.txt
d2 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.14, fa4, 50x32
w2 178.16 @ 1.83 · n=3w3 175.90 @ 1.97 · n=3w8 140.50 @ 2.21 · n=3
All 41 cells (best-by-cell, with rounds and source)
modebenchreq×newwdcondFGSGLangbackendflagsntok/smin–maxacceptsource
censusmt_bench1×3232primedoff0.5.16fa42117.47115.66–119.282.29width_ab_20260924_230059.txt width_ab_20260924_235033.txt
censusmt_bench1×3233primedoff0.5.16fa41106.27106.27–106.272.67width_ab_20260924_235212.txt
censusmt_bench1×3232unprimedoff0.5.16fa42154.00153.85–154.141.68width_ab_20260924_230009.txt width_ab_20260924_234943.txt
censusmt_bench1×3233unprimedoff0.5.16fa41111.16111.16–111.161.60width_ab_20260924_235123.txt
pairhumaneval50×3232primedoff0.5.16fa4178.6578.65–78.652.88width_ab_20260924_232332.txt
pairhumaneval50×3233primedoff0.5.16fa4178.2078.20–78.203.82width_ab_20260924_232332.txt
pairhumaneval50×3235primedoff0.5.16fa4172.8972.89–72.895.08width_ab_20260924_232332.txt
pairhumaneval50×3238primedoff0.5.16fa4169.7169.71–69.716.67width_ab_20260924_232332.txt
pairhumaneval50×32310primedoff0.5.16fa4167.8467.84–67.847.44width_ab_20260924_232332.txt
pairhumaneval50×32315primedoff0.5.16fa4161.1361.13–61.138.60width_ab_20260924_232332.txt
pairhumaneval80×1024415primedoff0.5.16fa4171.4771.47–71.477.50width_ab_20260925_002450.txt
pairhumaneval50×3222unprimedoff0.5.16fa42120.72120.37–121.071.91width_ab_20260924_230441.txt
pairhumaneval50×3232unprimedoff0.5.16fa43119.98119.37–120.922.06width_ab_20260924_230441.txt width_ab_20260924_231612.txt
pairhumaneval50×3233unprimedoff0.5.16fa41105.12105.12–105.122.22width_ab_20260924_231612.txt
pairhumaneval50×3235unprimedoff0.5.16fa4185.5285.52–85.522.38width_ab_20260924_231612.txt
pairhumaneval50×3238unprimedoff0.5.16fa4164.5564.55–64.552.40width_ab_20260924_231612.txt
pairhumaneval50×32310unprimedoff0.5.16fa4155.0555.05–55.052.40width_ab_20260924_231612.txt
pairhumaneval50×32315unprimedoff0.5.16fa4140.2040.20–40.202.38width_ab_20260924_231612.txt
pairhumaneval80×1024415unprimedoff0.5.16fa4156.7456.74–56.744.25width_ab_20260925_003212.txt
pairmt_bench50×3232primedoff0.5.16fa43118.57117.79–119.122.61width_ab_20260924_224150.txt width_ab_20260924_235301.txt
pairmt_bench50×3233primedoff0.5.16fa43110.52110.25–110.713.15width_ab_20260924_224150.txt width_ab_20260924_225205.txt width_ab_20260924_235301.txt
pairmt_bench50×3234primedoff0.5.16fa41104.75104.75–104.753.46width_ab_20260924_235301.txt
pairmt_bench50×3235primedoff0.5.16fa4297.0096.43–97.573.79width_ab_20260924_225205.txt width_ab_20260924_235301.txt
pairmt_bench50×3236primedoff0.5.16fa4191.2791.27–91.274.00width_ab_20260924_235301.txt
pairmt_bench50×3237primedoff0.5.16fa4286.2886.08–86.494.21width_ab_20260924_231439.txt width_ab_20260924_235301.txt
pairmt_bench50×3237primedoff0.5.16fa4TREE_PRIME_ROWS=161103.23103.23–103.233.05width_ab_20260924_231229.txt
pairmt_bench50×3237primedoff0.5.16fa4TREE_PRIME_ROWS=641108.67108.67–108.673.90width_ab_20260924_231335.txt
pairmt_bench50×3238primedoff0.5.16fa4183.6583.65–83.654.36width_ab_20260924_225205.txt
pairmt_bench50×32310primedoff0.5.16fa4173.7873.78–73.784.52width_ab_20260924_225205.txt
pairmt_bench50×32315primedoff0.5.16fa4257.7057.66–57.744.68width_ab_20260924_225205.txt width_ab_20260924_234352.txt
pairmt_bench50×32315primedoff0.5.16fa4TREE_PRIME_ROWS=128163.1663.16–63.164.60width_ab_20260924_234236.txt
pairmt_bench50×32315primedoff0.5.16fa4TREE_PRIME_ROWS=16157.4757.47–57.473.16width_ab_20260924_234003.txt
pairmt_bench50×32315primedoff0.5.16fa4TREE_PRIME_ROWS=64167.9067.90–67.904.27width_ab_20260924_234122.txt
pairmt_bench50×3222unprimedoff0.5.14fa43178.16176.71–180.271.83width_ab_20260924_223134.txt
pairmt_bench50×3232unprimedoff0.5.14fa43175.90174.38–177.861.97width_ab_20260924_223134.txt
pairmt_bench50×3282unprimedoff0.5.14fa43140.50140.05–140.792.21width_ab_20260924_223807.txt
pairmt_bench50×3233unprimedoff0.5.16fa41142.22142.22–142.222.08width_ab_20260924_224558.txt
pairmt_bench50×3235unprimedoff0.5.16fa41102.85102.85–102.852.14width_ab_20260924_224558.txt
pairmt_bench50×3238unprimedoff0.5.16fa4171.3371.33–71.332.15width_ab_20260924_224558.txt
pairmt_bench50×32310unprimedoff0.5.16fa4158.5658.56–58.562.14width_ab_20260924_224558.txt
pairmt_bench50×32315unprimedoff0.5.16fa4141.3941.39–41.392.15width_ab_20260924_224558.txt
Census, 1 request (per-phase cycles)
wdcondtok/sacceptHEAD G4HEAD G5TAIL GLMTAIL TREEsource
32unprimed154.141.6813580703135424940001981776width_ab_20260924_230009.txt census_w3d2_20260924_230009.txt
32primed115.662.29357469018561703640001460256width_ab_20260924_230059.txt census_w3d2_20260924_230059.txt
32unprimed153.851.6813580703135424940001981776width_ab_20260924_234943.txt census_w3d2_20260924_234943.txt
32primed119.282.29357469018561703640001460256width_ab_20260924_235033.txt census_w3d2_20260924_235033.txt
33unprimed111.161.6023415005847969100003650640width_ab_20260924_235123.txt census_w3d3_20260924_235123.txt
33primed106.272.67404299027117585460002190384width_ab_20260924_235212.txt census_w3d3_20260924_235212.txt

E3+CF

HEAD E3 0xE4B711E3 + TAIL CF 0xE4B711CF

E1 + ATTN_PIPE

sessiondatetest scriptssettingsverdict
E3_FLASH09-25/home/y344shi/.claude/jobs/5b98fbdb/tmp/bringup_e3.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/e3_ladder_a.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/e3_census.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/depth_sweep_e3_hum.sh
pair_width_ab.sh
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off; backend fa4; 17 armstexts 50/50 = E1; mt w3 d2 180.74 @1.97 (+2.8% vs E1, 3 rounds); G5 2.0x (unprimed) / 4.0-4.3x (primed) less; hum unprimed d2-d10 run, then PAUSED by the user (d15 + primed half not run)
from_box1/20260925/E3_FLASH/REPORT.md
tok/s vs depth (50×32; hover a point for accept, rounds and source)
0 50 100 150 2 3 5 8 10 tree depth d tok/s hum unprimed w3 d2: 120.16 tok/s @ 2.06 accept (n=1; width_ab_20260925_023719.txt) hum unprimed w3 d3: 103.96 tok/s @ 2.22 accept (n=1; width_ab_20260925_023719.txt) hum unprimed w3 d5: 84.43 tok/s @ 2.38 accept (n=1; width_ab_20260925_023719.txt) hum unprimed w3 d8: 66.51 tok/s @ 2.40 accept (n=1; width_ab_20260925_023719.txt) hum unprimed w3 d10: 56.13 tok/s @ 2.40 accept (n=1; arm log only) ■ hum unprimed w3
Depth ladders and width rows
w3 · humaneval unprimed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 120.16 @ 2.06 · n=1d3 103.96 @ 2.22 · n=1d5 84.43 @ 2.38 · n=1d8 66.51 @ 2.40 · n=1d10 56.13 @ 2.40 · n=1
source: arm, log, only, width_ab_20260925_023719.txt
w3 · mt_bench primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 116.72 @ 2.61 · n=2d3 108.36 @ 3.15 · n=1
source: width_ab_20260925_021936.txt, width_ab_20260925_023014.txt
d2 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.14, fa4, 50x32
w2 175.39 @ 1.83 · n=4w3 180.74 @ 1.97 · n=3
All 13 cells (best-by-cell, with rounds and source)
modebenchreq×newwdcondFGSGLangbackendflagsntok/smin–maxacceptsource
censusmt_bench1×3232primedoff0.5.16fa41126.29126.29–126.292.29width_ab_20260925_023501.txt
censusmt_bench1×3233primedoff0.5.16fa41117.38117.38–117.382.67width_ab_20260925_023321.txt
censusmt_bench1×3232unprimedoff0.5.16fa41139.89139.89–139.891.68width_ab_20260925_023551.txt
censusmt_bench1×3233unprimedoff0.5.16fa41119.41119.41–119.411.60width_ab_20260925_023410.txt
pairhumaneval50×3232unprimedoff0.5.16fa41120.16120.16–120.162.06width_ab_20260925_023719.txt
pairhumaneval50×3233unprimedoff0.5.16fa41103.96103.96–103.962.22width_ab_20260925_023719.txt
pairhumaneval50×3235unprimedoff0.5.16fa4184.4384.43–84.432.38width_ab_20260925_023719.txt
pairhumaneval50×3238unprimedoff0.5.16fa4166.5166.51–66.512.40width_ab_20260925_023719.txt
pairhumaneval50×32310unprimedoff0.5.16fa4156.1356.13–56.132.40arm log only
pairmt_bench50×3232primedoff0.5.16fa42116.72115.84–117.612.61width_ab_20260925_021936.txt width_ab_20260925_023014.txt
pairmt_bench50×3233primedoff0.5.16fa41108.36108.36–108.363.15width_ab_20260925_023014.txt
pairmt_bench50×3222unprimedoff0.5.14fa44175.39164.08–186.141.83width_ab_20260925_021737.txt width_ab_20260925_022343.txt
pairmt_bench50×3232unprimedoff0.5.14fa43180.74179.21–181.531.97width_ab_20260925_022343.txt
Census, 1 request (per-phase cycles)
wdcondtok/sacceptHEAD G4HEAD G5TAIL GLMTAIL TREEsource
33primed117.382.6740429906321585460002190384width_ab_20260925_023321.txt census_w3d3_20260925_023321.txt
33unprimed119.411.6023415002862689100003650640width_ab_20260925_023410.txt census_w3d3_20260925_023410.txt
32primed126.292.2935746904693863640001460256width_ab_20260925_023501.txt census_w3d2_20260925_023501.txt
32unprimed139.891.6813580701589024940001981776width_ab_20260925_023551.txt census_w3d2_20260925_023551.txt

E7+F3

HEAD E7 0xE4B711E7 + TAIL F3 0xE4B711F3

256-lane HEAD + faster TAIL

sessiondatetest scriptssettingsverdict
E7F3_FLASH09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/flash_e7.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/flash_f3.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/bringup_e7f3.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/e7f3_ladder.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/e7f3_mt_ab.sh
pair_census.sh
pair_width_ab.sh
/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/.claude/worktrees/velvety-puzzling-blossom/scripts/pair_tail_width_reset.py (allowlist CF -> CF/F1/F3)
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off; backend fa4; 23 armstexts 50/50 = E1+CF; mt w2 191.52 / w3 188.50 (3 rounds, +7.5% / +7.2% vs E1); HEAD G4 0.506x, TAIL GLM 0.25x + TREE -38%; hum unprimed +3.5..+16.8% vs E1
from_box1/20260926/E7F3_FLASH/REPORT.md
GPU_EXTEND_IN_PAIR09-26/sanctuary/lab/results/2026-09-26/GPU_EXTEND_IN_PAIR/run_gpu_extend.sh
ab_glue_e7f3.sh
extend_table.py
—SGLang drafter extend = 0.79-0.97 ms GPU per verify step (6-8% of the step), inside the measured tok/s (profiled runs; tok/s not comparable)
from_box1/20260926/GPU_EXTEND_IN_PAIR/REPORT.md
tok/s vs depth (50×32; hover a point for accept, rounds and source)
0 50 100 150 2 3 5 8 10 15 tree depth d tok/s hum unprimed w3 d2: 125.18 tok/s @ 2.06 accept (n=1; width_ab_20260926_120616.txt) hum unprimed w3 d3: 112.38 tok/s @ 2.22 accept (n=1; width_ab_20260926_120616.txt) hum unprimed w3 d5: 93.37 tok/s @ 2.38 accept (n=1; width_ab_20260926_120616.txt) hum unprimed w3 d8: 72.85 tok/s @ 2.40 accept (n=1; width_ab_20260926_120616.txt) hum unprimed w3 d10: 62.92 tok/s @ 2.40 accept (n=1; width_ab_20260926_120616.txt) hum unprimed w3 d15: 46.96 tok/s @ 2.38 accept (n=1; width_ab_20260926_120616.txt) hum primed w3 d2: 84.31 tok/s @ 2.88 accept (n=1; width_ab_20260926_121324.txt) hum primed w3 d3: 82.58 tok/s @ 3.82 accept (n=1; width_ab_20260926_121324.txt) hum primed w3 d5: 77.75 tok/s @ 5.08 accept (n=1; width_ab_20260926_121324.txt) hum primed w3 d8: 73.06 tok/s @ 6.67 accept (n=1; width_ab_20260926_121324.txt) hum primed w3 d10: 71.53 tok/s @ 7.44 accept (n=1; width_ab_20260926_121324.txt) hum primed w3 d15: 65.32 tok/s @ 8.60 accept (n=1; width_ab_20260926_121324.txt) ■ hum primed w3 ■ hum unprimed w3
Depth ladders and width rows
w3 · humaneval primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 84.31 @ 2.88 · n=1d3 82.58 @ 3.82 · n=1d5 77.75 @ 5.08 · n=1d8 73.06 @ 6.67 · n=1d10 71.53 @ 7.44 · n=1d15 65.32 @ 8.60 · n=1
source: width_ab_20260926_121324.txt
w3 · humaneval unprimed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 125.18 @ 2.06 · n=1d3 112.38 @ 2.22 · n=1d5 93.37 @ 2.38 · n=1d8 72.85 @ 2.40 · n=1d10 62.92 @ 2.40 · n=1d15 46.96 @ 2.38 · n=1
source: width_ab_20260926_120616.txt
d2 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.14, fa4, 50x32
w2 190.75 @ 1.83 · n=4w3 188.50 @ 1.97 · n=3
All 18 cells (best-by-cell, with rounds and source)
modebenchreq×newwdcondFGSGLangbackendflagsntok/smin–maxacceptsource
censusmt_bench1×3232primedoff0.5.16fa41126.99126.99–126.992.29width_ab_20260926_120436.txt
censusmt_bench1×3233primedoff0.5.16fa41116.99116.99–116.992.67width_ab_20260926_120208.txt
censusmt_bench1×3232unprimedoff0.5.16fa41162.31162.31–162.311.68width_ab_20260926_120527.txt
censusmt_bench1×3233unprimedoff0.5.16fa41124.37124.37–124.371.60width_ab_20260926_120346.txt
pairhumaneval50×3232primedoff0.5.16fa4184.3184.31–84.312.88width_ab_20260926_121324.txt
pairhumaneval50×3233primedoff0.5.16fa4182.5882.58–82.583.82width_ab_20260926_121324.txt
pairhumaneval50×3235primedoff0.5.16fa4177.7577.75–77.755.08width_ab_20260926_121324.txt
pairhumaneval50×3238primedoff0.5.16fa4173.0673.06–73.066.67width_ab_20260926_121324.txt
pairhumaneval50×32310primedoff0.5.16fa4171.5371.53–71.537.44width_ab_20260926_121324.txt
pairhumaneval50×32315primedoff0.5.16fa4165.3265.32–65.328.60width_ab_20260926_121324.txt
pairhumaneval50×3232unprimedoff0.5.16fa41125.18125.18–125.182.06width_ab_20260926_120616.txt
pairhumaneval50×3233unprimedoff0.5.16fa41112.38112.38–112.382.22width_ab_20260926_120616.txt
pairhumaneval50×3235unprimedoff0.5.16fa4193.3793.37–93.372.38width_ab_20260926_120616.txt
pairhumaneval50×3238unprimedoff0.5.16fa4172.8572.85–72.852.40width_ab_20260926_120616.txt
pairhumaneval50×32310unprimedoff0.5.16fa4162.9262.92–62.922.40width_ab_20260926_120616.txt
pairhumaneval50×32315unprimedoff0.5.16fa4146.9646.96–46.962.38width_ab_20260926_120616.txt
pairmt_bench50×3222unprimedoff0.5.14fa44190.75188.44–192.611.83width_ab_20260926_120017.txt width_ab_20260926_122111.txt
pairmt_bench50×3232unprimedoff0.5.14fa43188.50186.79–190.631.97width_ab_20260926_122111.txt
Census, 1 request (per-phase cycles)
wdcondtok/sacceptHEAD G4HEAD G5TAIL GLMTAIL TREEsource
33primed116.992.67204765427117581367521350384width_ab_20260926_120208.txt census_w3d3_20260926_120208.txt
33unprimed124.371.6011859005847962279202250640width_ab_20260926_120346.txt census_w3d3_20260926_120346.txt
32primed126.992.291810474185617091168900256width_ab_20260926_120436.txt census_w3d2_20260926_120436.txt
32unprimed162.311.686878223135421237281221776width_ab_20260926_120527.txt census_w3d2_20260926_120526.txt

C7+F4

HEAD C7 0xE4B711C7 + TAIL F4 0xE4B711F4

KVI v2 HEAD (128 lanes) + G12X TAIL

sessiondatetest scriptssettingsverdict
C7F4_FLASH09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/flash_c7_f4.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/bringup_c7f4.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/c7f4_ladder.sh
kvi_silicon_ab.py --l0-only
pair_census.sh
pair_width_ab.sh
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off; backend fa4; 8 armsKVI off: texts 50/50 = E1+CF; mt w2 177.84 / w3 181.13 @1.98 (3 rounds); TAIL TREE -33.2%/step vs F3; KVI L0 PASS; ladder stopped at hum unprimed d10 ("next image")
from_box1/20260926/C7F4_FLASH/REPORT.md
tok/s vs depth (50×32; hover a point for accept, rounds and source)
0 50 100 150 2 3 5 8 10 tree depth d tok/s hum unprimed w3 d2: 119.27 tok/s @ 2.07 accept (n=1; width_ab_20260926_141459.txt) hum unprimed w3 d3: 103.75 tok/s @ 2.24 accept (n=1; width_ab_20260926_141459.txt) hum unprimed w3 d5: 86.67 tok/s @ 2.39 accept (n=1; width_ab_20260926_141459.txt) hum unprimed w3 d8: 67.26 tok/s @ 2.41 accept (n=1; width_ab_20260926_141459.txt) hum unprimed w3 d10: 57.42 tok/s @ 2.40 accept (n=1; arm log only) ■ hum unprimed w3
Depth ladders and width rows
w3 · humaneval unprimed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 119.27 @ 2.07 · n=1d3 103.75 @ 2.24 · n=1d5 86.67 @ 2.39 · n=1d8 67.26 @ 2.41 · n=1d10 57.42 @ 2.40 · n=1
source: arm, log, only, width_ab_20260926_141459.txt
d2 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.14, fa4, 50x32
w2 177.84 @ 1.83 · n=3w3 181.13 @ 1.98 · n=3
All 11 cells (best-by-cell, with rounds and source)
modebenchreq×newwdcondFGSGLangbackendflagsntok/smin–maxacceptsource
censusmt_bench1×3232primedoff0.5.16fa41124.56124.56–124.562.29width_ab_20260926_141314.txt
censusmt_bench1×3233primedoff0.5.16fa41120.90120.90–120.902.91width_ab_20260926_141040.txt
censusmt_bench1×3232unprimedoff0.5.16fa41158.69158.69–158.691.68width_ab_20260926_141407.txt
censusmt_bench1×3233unprimedoff0.5.16fa41119.34119.34–119.341.60width_ab_20260926_141222.txt
pairhumaneval50×3232unprimedoff0.5.16fa41119.27119.27–119.272.07width_ab_20260926_141459.txt
pairhumaneval50×3233unprimedoff0.5.16fa41103.75103.75–103.752.24width_ab_20260926_141459.txt
pairhumaneval50×3235unprimedoff0.5.16fa4186.6786.67–86.672.39width_ab_20260926_141459.txt
pairhumaneval50×3238unprimedoff0.5.16fa4167.2667.26–67.262.41width_ab_20260926_141459.txt
pairhumaneval50×32310unprimedoff0.5.16fa4157.4257.42–57.422.40arm log only
pairmt_bench50×3222unprimedoff0.5.14fa43177.84169.78–185.701.83width_ab_20260926_140347.txt
pairmt_bench50×3232unprimedoff0.5.14fa43181.13176.09–185.311.98width_ab_20260926_140347.txt
Census, 1 request (per-phase cycles)
wdcondtok/sacceptHEAD G4HEAD G5TAIL GLMTAIL TREEsource
33primed120.902.913949330591618125356826518width_ab_20260926_141040.txt census_w3d3_20260926_141040.txt
33unprimed119.341.6023415002862682279201502760width_ab_20260926_141222.txt census_w3d3_20260926_141222.txt
32primed124.562.29357469046938691168601104width_ab_20260926_141314.txt census_w3d2_20260926_141314.txt
32unprimed158.691.681358070158902123728815784width_ab_20260926_141407.txt census_w3d2_20260926_141406.txt

A8+F4

HEAD A8 0xE4B711A8 + TAIL F4 0xE4B711F4

KVI v2 + 256 lanes; KVI, FASTGLUE and backend levers

sessiondatetest scriptssettingsverdict
A8F4_FLASH09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/flash_a8.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/bringup_a8f4.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/a8f4_ladder.sh
kvi_silicon_ab.py (L0)
pair_census.sh
pair_width_ab.sh
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off; backend fa4; 6 armsKVI off: texts 50/50 = E1+CF; LANES=256, 0 drops; mt w2 188.34 / w3 187.68 @1.98 (3 rounds, launcher-default host path); KVI L0 PASS
from_box1/20260926/A8F4_FLASH/REPORT.md
HOST_GLUE09-26/sanctuary/pdi_inbox/HOST_GLUE/host_glue_fastglue/lab_fastglue_ab.sh (FASTGLUE v2; arms A / F1 / F2)
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/a8f4_ladder.sh
SGLang 0.5.14/0.5.16; KVI no/yes; FASTGLUE off/v1/v2/v3/v4; backend fa4; 95 armsFASTGLUE v2: F2 ties A (w2 187.69 vs 188.34; w3 188.07 vs 187.68); F1 loses w2 3/3 -> dropped
from_box1/20260926/A8F4_FLASH/REPORT.md
HOST_GLUE_V309-26/sanctuary/pdi_inbox/HOST_GLUE/v3/host_glue_fastglue/lab_fastglue_ab.sh (FASTGLUE=3, arms A / F3 / F2)
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/a8f4_chain.sh
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off/v2/v3; backend fa4; 24 armsF3 wins 3/3 at both widths: w2 203.94 @1.83 (+8.7%), w3 202.37 @1.98 (+7.8%); host glue G median 3.25 -> 1.92 ms; texts 50/50
from_box1/20260926/HOST_GLUE_V3/REPORT.md
A8F4_KVI09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/a8f4_kvi.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/a8f4_L1.sh
kvi_silicon_ab.py (L0/L1)
/home/y344shi/workspace/eagle4_adaptation/hardware/cleanup_EAGLE/.claude/worktrees/velvety-puzzling-blossom/scripts/run_test_b_kvi.sh (L2)
pair_width_ab_kvi.sh (L3)
pair_width_ab.sh (controls)
SGLang 0.5.16; KVI yes; FASTGLUE off/v4; backend fa4; 28 armsKVI L0/L1/L2/L3 PASS; L2 identical tree, prime 18 vs 170 ms (9.4x); L3 mt w3 d2 220.56 @2.61 (1.74x card-primed); hum KVI 1.53-1.66x card-primed
from_box1/20260926/A8F4_KVI/REPORT.md
A8F4_KVI_LEVERS09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/a8f4_backend_grid.sh
pair_width_ab_kvi.sh (BACKEND / --attention-backend arms)
—keep T0 (target flashinfer + draft fa4): T0 219.57 / 204.07; draft fa3 tie; target fa3 -5.4% / -2.9% (d2 / d3)
from_box1/20260926/A8F4_KVI_LEVERS/REPORT.md
HOST_GLUE_V409-26/sanctuary/pdi_inbox/HOST_GLUE/v4/host_glue_fastglue/lab_fastglue_kvi_ab.sh
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/a8f4_backend_grid.sh
SGLang 0.5.16; KVI yes; FASTGLUE off/v4; backend fa4; 47 armsINVALID: pair_width_ab_kvi.sh:25 forced OVERLAP_CATCHUP=0 / EARLY_LAUNCH=0 over FASTGLUE=4 (fixed f536bad6); re-run in HOST_GLUE_V4_FIXED
from_box1/20260926/A8F4_KVI_LEVERS/REPORT.md
HOST_GLUE_V4_FIXED09-26/sanctuary/pdi_inbox/HOST_GLUE/v4/host_glue_fastglue/lab_fastglue_kvi_ab.sh (arms K / K4 / K4OV)
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/v4_rerun.sh, /home/y344shi/.claude/jobs/5b98fbdb/tmp/v4_rerun2.sh
SGLang 0.5.16; KVI yes; FASTGLUE off/v4; backend fa4; 23 armsK4 (KVI + FASTGLUE=4) wins 3/3: w2 234.62 @2.55, w3 222.10 @2.61 (+2.2% / +1.6% vs K); texts 50/50
from_box1/20260926/HOST_GLUE_V4_FIXED/REPORT.md
HOST_GLUE_V4209-26/sanctuary/pdi_inbox/HOST_GLUE/v4_2/host_glue_fastglue/lab_fastglue_kvi_ab.sh (profile phase)
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/v42_grid.sh
SGLang 0.5.16; KVI yes; FASTGLUE off/v4; backend fa4; 4 armsv4.2 profile: host glue G median K 3.176 -> K4 2.221 ms (profiled arms; tok/s not comparable)
from_box1/20260926/HOST_GLUE_V43/REPORT.md
A8F4_KVI_GRID09-26pair_width_ab_kvi.sh with FASTGLUE=4 v4.2 (/sanctuary/pdi_inbox/HOST_GLUE/v4_2)
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/v42_grid.sh
SGLang 0.5.16; KVI yes; FASTGLUE v4; backend fa4; 25 armsKVI + FASTGLUE=4 grid w{2,3,4,6,8} x d{2,3,4,5,7}: sweet point w2 d2 230.66 @2.55; smaller trees faster at every depth
from_box1/20260926/A8F4_KVI_GRID/REPORT.md
HOST_GLUE_V4309-26/sanctuary/pdi_inbox/HOST_GLUE/v4_3/host_glue_fastglue/lab_fastglue_kvi_ab.sh (arms K / K4 / K4OV)
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/v42_speed.sh
SGLang 0.5.16; KVI yes; FASTGLUE off/v4; backend fa4; 18 armsv4.3 confirms: K4 w2 233.87 / w3 222.03 (3 rounds; +0.8% / +1.2% vs K); texts 50/50
from_box1/20260926/HOST_GLUE_V43/REPORT.md
tok/s vs depth (50×32; hover a point for accept, rounds and source)
0 50 100 150 200 250 2 3 4 5 7 10 15 tree depth d tok/s hum primed w3 d2: 82.81 tok/s @ 2.88 accept (n=1; width_ab_20260926_164034.txt) hum primed w3 d5: 77.21 tok/s @ 5.10 accept (n=1; width_ab_20260926_164034.txt) hum primed w3 d10: 73.40 tok/s @ 7.51 accept (n=1; width_ab_20260926_164034.txt) hum primed w3 d15: 66.49 tok/s @ 8.74 accept (n=1; width_ab_20260926_164034.txt) mt unprimed w3 d2: 187.74 tok/s @ 1.98 accept (n=1; width_ab_20260926_163152.txt) mt unprimed w3 d3: 155.29 tok/s @ 2.09 accept (n=1; width_ab_20260926_163152.txt) mt unprimed w3 d5: 118.80 tok/s @ 2.15 accept (n=1; width_ab_20260926_163152.txt) mt unprimed w3 d7: 92.60 tok/s @ 2.15 accept (n=1; width_ab_20260926_163152.txt) mt primed w3 d2: 126.72 tok/s @ 2.62 accept (n=1; width_ab_20260926_162727.txt) mt primed w3 d3: 119.18 tok/s @ 3.19 accept (n=1; width_ab_20260926_162727.txt) mt primed w3 d5: 109.00 tok/s @ 3.80 accept (n=1; width_ab_20260926_162727.txt) mt primed w3 d7: 96.98 tok/s @ 4.22 accept (n=1; width_ab_20260926_162727.txt) mt KVI w3 d2: 217.18 tok/s @ 2.61 accept (n=17; width_ab_20260926_162324.txt width_ab_20260926_164605.txt width_ab_20260926_164803.txt width_ab_20260926_165133.txt width_ab_20260926_165502.txt width_ab_20260926_165830.txt width_ab_20260926_170029.txt width_ab_20260926_170228.txt width_ab_20260926_170544.txt width_ab_20260926_170839.txt width_ab_20260926_171417.txt width_ab_20260926_172344.txt width_ab_20260926_172730.txt width_ab_20260926_173323.txt width_ab_20260926_180328.txt width_ab_20260926_181252.txt width_ab_20260926_181638.txt) mt KVI w3 d3: 201.25 tok/s @ 3.20 accept (n=7; width_ab_20260926_162324.txt width_ab_20260926_164605.txt width_ab_20260926_164803.txt width_ab_20260926_165133.txt width_ab_20260926_165502.txt width_ab_20260926_165830.txt width_ab_20260926_170029.txt) mt KVI w3 d5: 173.87 tok/s @ 3.88 accept (n=1; width_ab_20260926_162324.txt) mt KVI w3 d7: 149.91 tok/s @ 4.35 accept (n=1; width_ab_20260926_162324.txt) hum KVI w3 d2: 137.64 tok/s @ 2.89 accept (n=1; width_ab_20260926_163609.txt) hum KVI w3 d5: 128.20 tok/s @ 5.14 accept (n=1; width_ab_20260926_163609.txt) hum KVI w3 d10: 116.45 tok/s @ 7.62 accept (n=1; width_ab_20260926_163609.txt) hum KVI w3 d15: 101.64 tok/s @ 8.99 accept (n=1; width_ab_20260926_163609.txt) mt KVI+FASTGLUE4 w2 d2: 233.73 tok/s @ 2.55 accept (n=7; width_ab_20260926_171610.txt width_ab_20260926_171957.txt width_ab_20260926_172923.txt width_ab_20260926_173719.txt width_ab_20260926_180521.txt width_ab_20260926_180907.txt width_ab_20260926_181829.txt) mt KVI+FASTGLUE4 w2 d3: 222.27 tok/s @ 3.01 accept (n=1; width_ab_20260926_173719.txt) mt KVI+FASTGLUE4 w2 d4: 205.73 tok/s @ 3.31 accept (n=1; width_ab_20260926_173719.txt) mt KVI+FASTGLUE4 w2 d5: 195.34 tok/s @ 3.64 accept (n=1; width_ab_20260926_173719.txt) mt KVI+FASTGLUE4 w2 d7: 168.02 tok/s @ 3.98 accept (n=1; width_ab_20260926_173719.txt) ■ mt KVI+FASTGLUE4 w2 ■ mt KVI w3 ■ hum KVI w3 ■ mt primed w3 ■ mt unprimed w3 ■ hum primed w3
w × d grid — mt_bench KVI, FASTGLUE off, SGLang 0.5.16, fa4, 50x32, flags: PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=0
d \ ww2w3
d2230.83@ 2.55 · n=6217.18@ 2.61 · n=17
d3—201.25@ 3.20 · n=7
d5—173.87@ 3.88 · n=1
d7—149.91@ 4.35 · n=1
source: width_ab_20260926_162324.txt, width_ab_20260926_164605.txt, width_ab_20260926_164803.txt, width_ab_20260926_165133.txt, width_ab_20260926_165502.txt, width_ab_20260926_165830.txt, width_ab_20260926_170029.txt, width_ab_20260926_170228.txt, width_ab_20260926_170544.txt, width_ab_20260926_170839.txt, width_ab_20260926_171417.txt, width_ab_20260926_172344.txt, width_ab_20260926_172730.txt, width_ab_20260926_173323.txt, width_ab_20260926_180328.txt, width_ab_20260926_181252.txt, width_ab_20260926_181638.txt
w × d grid — mt_bench KVI, FASTGLUE v4, SGLang 0.5.16, fa4, 50x32, flags: PAIR_SKIP_GPU_EXTEND=0
d \ ww2w3w4w6w8
d2233.73@ 2.55 · n=7221.82@ 2.61 · n=10208.98@ 2.68 · n=1179.97@ 2.71 · n=1166.41@ 2.74 · n=1
d3222.27@ 3.01 · n=1203.88@ 3.20 · n=1189.16@ 3.29 · n=1163.14@ 3.40 · n=1139.05@ 3.43 · n=1
d4205.73@ 3.31 · n=1184.02@ 3.51 · n=1167.72@ 3.63 · n=1141.08@ 3.81 · n=1118.77@ 3.83 · n=1
d5195.34@ 3.64 · n=1173.75@ 3.88 · n=1155.73@ 4.02 · n=1125.96@ 4.20 · n=1107.34@ 4.22 · n=1
d7168.02@ 3.98 · n=1150.23@ 4.35 · n=1133.07@ 4.56 · n=1106.13@ 4.72 · n=188.50@ 4.76 · n=1
source: width_ab_20260926_170643.txt, width_ab_20260926_170938.txt, width_ab_20260926_171610.txt, width_ab_20260926_171957.txt, width_ab_20260926_172923.txt, width_ab_20260926_173422.txt, width_ab_20260926_173719.txt, width_ab_20260926_180521.txt, width_ab_20260926_180907.txt, width_ab_20260926_181829.txt
Depth ladders and width rows
w3 · humaneval KVI, FASTGLUE off, SGLang 0.5.16, fa4, 50x32, flags: PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=0
d2 137.64 @ 2.89 · n=1d5 128.20 @ 5.14 · n=1d10 116.45 @ 7.62 · n=1d15 101.64 @ 8.99 · n=1
source: width_ab_20260926_163609.txt
w3 · humaneval primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 82.81 @ 2.88 · n=1d5 77.21 @ 5.10 · n=1d10 73.40 @ 7.51 · n=1d15 66.49 @ 8.74 · n=1
source: width_ab_20260926_164034.txt
w3 · mt_bench KVI, FASTGLUE off, SGLang 0.5.16, fa3, 50x32, flags: PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=0
d2 218.92 @ 2.61 · n=3d3 203.26 @ 3.20 · n=3
source: width_ab_20260926_165002.txt, width_ab_20260926_165331.txt, width_ab_20260926_165700.txt
w3 · mt_bench primed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 126.72 @ 2.62 · n=1d3 119.18 @ 3.19 · n=1d5 109.00 @ 3.80 · n=1d7 96.98 @ 4.22 · n=1
source: width_ab_20260926_162727.txt
w3 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d2 187.74 @ 1.98 · n=1d3 155.29 @ 2.09 · n=1d5 118.80 @ 2.15 · n=1d7 92.60 @ 2.15 · n=1
source: width_ab_20260926_163152.txt
d2 · mt_bench KVI, FASTGLUE v4, SGLang 0.5.16, fa4, 50x32, flags: PAIR_KVI_OVERLAP=1 PAIR_SKIP_GPU_EXTEND=0
w2 231.72 @ 2.55 · n=6w3 219.80 @ 2.61 · n=7
d2 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.14, fa4, 50x32
w2 188.91 @ 1.83 · n=9w3 187.87 @ 1.98 · n=7
d2 · mt_bench unprimed, FASTGLUE v1, SGLang 0.5.14, fa4, 50x32
w2 175.20 @ 1.83 · n=4w3 186.39 @ 1.98 · n=3
d2 · mt_bench unprimed, FASTGLUE v2, SGLang 0.5.14, fa4, 50x32
w2 187.13 @ 1.83 · n=8w3 188.58 @ 1.98 · n=6
d2 · mt_bench unprimed, FASTGLUE v3, SGLang 0.5.14, fa4, 50x32
w2 204.50 @ 1.83 · n=4w3 202.37 @ 1.98 · n=3
All 65 cells (best-by-cell, with rounds and source)
modebenchreq×newwdcondFGSGLangbackendflagsntok/smin–maxacceptsource
censusmt_bench1×3232primedoff0.5.16fa41126.22126.22–126.222.29width_ab_20260926_154829.txt
censusmt_bench1×3233primedoff0.5.16fa41120.27120.27–120.272.91width_ab_20260926_154556.txt
censusmt_bench1×3232unprimedoff0.5.16fa41164.14164.14–164.141.68width_ab_20260926_154922.txt
censusmt_bench1×3233unprimedoff0.5.16fa41121.25121.25–121.251.60width_ab_20260926_154737.txt
pairhumaneval50×3232KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01137.64137.64–137.642.89width_ab_20260926_163609.txt
pairhumaneval50×3235KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01128.20128.20–128.205.14width_ab_20260926_163609.txt
pairhumaneval50×32310KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01116.45116.45–116.457.62width_ab_20260926_163609.txt
pairhumaneval50×32315KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01101.64101.64–101.648.99width_ab_20260926_163609.txt
pairhumaneval50×3232primedoff0.5.16fa4182.8182.81–82.812.88width_ab_20260926_164034.txt
pairhumaneval50×3235primedoff0.5.16fa4177.2177.21–77.215.10width_ab_20260926_164034.txt
pairhumaneval50×32310primedoff0.5.16fa4173.4073.40–73.407.51width_ab_20260926_164034.txt
pairhumaneval50×32315primedoff0.5.16fa4166.4966.49–66.498.74width_ab_20260926_164034.txt
pairmt_bench50×3222KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=06230.83228.77–232.912.55width_ab_20260926_171417.txt width_ab_20260926_172344.txt width_ab_20260926_172730.txt width_ab_20260926_180328.txt width_ab_20260926_181252.txt width_ab_20260926_181638.txt
pairmt_bench50×3232KVIoff0.5.16fa3PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=03218.92217.92–220.592.61width_ab_20260926_165002.txt width_ab_20260926_165331.txt width_ab_20260926_165700.txt
pairmt_bench50×3232KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=017217.18206.33–220.842.61width_ab_20260926_162324.txt width_ab_20260926_164605.txt width_ab_20260926_164803.txt width_ab_20260926_165133.txt width_ab_20260926_165502.txt width_ab_20260926_165830.txt width_ab_20260926_170029.txt width_ab_20260926_170228.txt width_ab_20260926_170544.txt width_ab_20260926_170839.txt width_ab_20260926_171417.txt width_ab_20260926_172344.txt width_ab_20260926_172730.txt width_ab_20260926_173323.txt width_ab_20260926_180328.txt width_ab_20260926_181252.txt width_ab_20260926_181638.txt
pairmt_bench5×3233KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREEV=1 TREE_OVERLAP_CATCHUP=0 TREE_VERBOSE=11175.92175.92–175.922.86width_ab_20260926_162153.txt
pairmt_bench50×3233KVIoff0.5.16fa3PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=03203.26202.77–203.603.20width_ab_20260926_165002.txt width_ab_20260926_165331.txt width_ab_20260926_165700.txt
pairmt_bench50×3233KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=07201.25197.88–204.763.20width_ab_20260926_162324.txt width_ab_20260926_164605.txt width_ab_20260926_164803.txt width_ab_20260926_165133.txt width_ab_20260926_165502.txt width_ab_20260926_165830.txt width_ab_20260926_170029.txt
pairmt_bench50×3235KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01173.87173.87–173.873.88width_ab_20260926_162324.txt
pairmt_bench50×3237KVIoff0.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01149.91149.91–149.914.35width_ab_20260926_162324.txt
pairmt_bench50×3222KVIv40.5.16fa4PAIR_KVI_OVERLAP=1 PAIR_SKIP_GPU_EXTEND=06231.72230.26–233.682.55width_ab_20260926_171804.txt width_ab_20260926_172150.txt width_ab_20260926_172537.txt width_ab_20260926_180714.txt width_ab_20260926_181059.txt width_ab_20260926_181445.txt
pairmt_bench50×3222KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=07233.73230.66–234.712.55width_ab_20260926_171610.txt width_ab_20260926_171957.txt width_ab_20260926_172923.txt width_ab_20260926_173719.txt width_ab_20260926_180521.txt width_ab_20260926_180907.txt width_ab_20260926_181829.txt
pairmt_bench50×3223KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01222.27222.27–222.273.01width_ab_20260926_173719.txt
pairmt_bench50×3224KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01205.73205.73–205.733.31width_ab_20260926_173719.txt
pairmt_bench50×3225KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01195.34195.34–195.343.64width_ab_20260926_173719.txt
pairmt_bench50×3227KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01168.02168.02–168.023.98width_ab_20260926_173719.txt
pairmt_bench50×3232KVIv40.5.16fa4PAIR_KVI_OVERLAP=1 PAIR_SKIP_GPU_EXTEND=07219.80218.86–220.712.61width_ab_20260926_171036.txt width_ab_20260926_171804.txt width_ab_20260926_172150.txt width_ab_20260926_172537.txt width_ab_20260926_180714.txt width_ab_20260926_181059.txt width_ab_20260926_181445.txt
pairmt_bench50×3232KVIv40.5.16fa4PAIR_KVI_OVERLAP=1 PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01218.50218.50–218.502.61arm log only
pairmt_bench50×3232KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=010221.82220.13–223.002.61width_ab_20260926_170643.txt width_ab_20260926_170938.txt width_ab_20260926_171610.txt width_ab_20260926_171957.txt width_ab_20260926_172923.txt width_ab_20260926_173422.txt width_ab_20260926_173719.txt width_ab_20260926_180521.txt width_ab_20260926_180907.txt width_ab_20260926_181829.txt
pairmt_bench50×3232KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=0 TREE_OVERLAP_CATCHUP=01219.56219.56–219.562.61width_ab_20260926_170327.txt
pairmt_bench50×3233KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01203.88203.88–203.883.20width_ab_20260926_173719.txt
pairmt_bench50×3234KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01184.02184.02–184.023.51width_ab_20260926_173719.txt
pairmt_bench50×3235KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01173.75173.75–173.753.88width_ab_20260926_173719.txt
pairmt_bench50×3237KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01150.23150.23–150.234.35width_ab_20260926_173719.txt
pairmt_bench50×3242KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01208.98208.98–208.982.68width_ab_20260926_173719.txt
pairmt_bench50×3243KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01189.16189.16–189.163.29width_ab_20260926_173719.txt
pairmt_bench50×3244KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01167.72167.72–167.723.63width_ab_20260926_173719.txt
pairmt_bench50×3245KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01155.73155.73–155.734.02width_ab_20260926_173719.txt
pairmt_bench50×3247KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01133.07133.07–133.074.56width_ab_20260926_173719.txt
pairmt_bench50×3262KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01179.97179.97–179.972.71width_ab_20260926_173719.txt
pairmt_bench50×3263KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01163.14163.14–163.143.40width_ab_20260926_173719.txt
pairmt_bench50×3264KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01141.08141.08–141.083.81width_ab_20260926_173719.txt
pairmt_bench50×3265KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01125.96125.96–125.964.20width_ab_20260926_173719.txt
pairmt_bench50×3267KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01106.13106.13–106.134.72width_ab_20260926_173719.txt
pairmt_bench50×3282KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01166.41166.41–166.412.74width_ab_20260926_173719.txt
pairmt_bench50×3283KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01139.05139.05–139.053.43width_ab_20260926_173719.txt
pairmt_bench50×3284KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01118.77118.77–118.773.83width_ab_20260926_173719.txt
pairmt_bench50×3285KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01107.34107.34–107.344.22width_ab_20260926_173719.txt
pairmt_bench50×3287KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=0188.5088.50–88.504.76width_ab_20260926_173719.txt
pairmt_bench50×3232primedoff0.5.16fa41126.72126.72–126.722.62width_ab_20260926_162727.txt
pairmt_bench50×3233primedoff0.5.16fa41119.18119.18–119.183.19width_ab_20260926_162727.txt
pairmt_bench50×3235primedoff0.5.16fa41109.00109.00–109.003.80width_ab_20260926_162727.txt
pairmt_bench50×3237primedoff0.5.16fa4196.9896.98–96.984.22width_ab_20260926_162727.txt
pairmt_bench50×3222unprimedoff0.5.14fa49188.91186.22–192.511.83width_ab_20260926_151804.txt width_ab_20260926_152058.txt width_ab_20260926_152747.txt width_ab_20260926_153813.txt width_ab_20260926_154205.txt width_ab_20260926_155044.txt width_ab_20260926_155816.txt width_ab_20260926_160840.txt width_ab_20260926_161231.txt
pairmt_bench50×3232unprimedoff0.5.14fa47187.87185.59–189.441.98width_ab_20260926_151804.txt width_ab_20260926_152747.txt width_ab_20260926_153813.txt width_ab_20260926_154205.txt width_ab_20260926_155816.txt width_ab_20260926_160840.txt width_ab_20260926_161231.txt
pairmt_bench50×3232unprimedoff0.5.16fa41187.74187.74–187.741.98width_ab_20260926_163152.txt
pairmt_bench50×3233unprimedoff0.5.16fa41155.29155.29–155.292.09width_ab_20260926_163152.txt
pairmt_bench50×3235unprimedoff0.5.16fa41118.80118.80–118.802.15width_ab_20260926_163152.txt
pairmt_bench50×3237unprimedoff0.5.16fa4192.6092.60–92.602.15width_ab_20260926_163152.txt
pairmt_bench50×3222unprimedv10.5.14fa44175.20172.71–177.981.83width_ab_20260926_152254.txt width_ab_20260926_153224.txt width_ab_20260926_153617.txt width_ab_20260926_154009.txt
pairmt_bench50×3232unprimedv10.5.14fa43186.39184.70–187.861.98width_ab_20260926_153224.txt width_ab_20260926_153617.txt width_ab_20260926_154009.txt
pairmt_bench50×3222unprimedv20.5.14fa48187.13178.77–193.821.83width_ab_20260926_152156.txt width_ab_20260926_153029.txt width_ab_20260926_153421.txt width_ab_20260926_154400.txt width_ab_20260926_155326.txt width_ab_20260926_160254.txt width_ab_20260926_160644.txt width_ab_20260926_161036.txt
pairmt_bench50×3232unprimedv20.5.14fa46188.58181.50–192.501.98width_ab_20260926_153029.txt width_ab_20260926_153421.txt width_ab_20260926_154400.txt width_ab_20260926_160254.txt width_ab_20260926_160644.txt width_ab_20260926_161036.txt
pairmt_bench50×3222unprimedv30.5.14fa44204.50203.85–206.181.83width_ab_20260926_155229.txt width_ab_20260926_160100.txt width_ab_20260926_160450.txt width_ab_20260926_161426.txt
pairmt_bench50×3232unprimedv30.5.14fa43202.37201.28–203.441.98width_ab_20260926_160100.txt width_ab_20260926_160450.txt width_ab_20260926_161426.txt
Census, 1 request (per-phase cycles)
wdcondtok/sacceptHEAD G4HEAD G5TAIL GLMTAIL TREEsource
33primed120.272.9120002182491282125356826518width_ab_20260926_154556.txt census_w3d3_20260926_154556.txt
33unprimed121.251.6011859005847962279201502760width_ab_20260926_154737.txt census_w3d3_20260926_154736.txt
32primed126.222.291810474185617091168601104width_ab_20260926_154829.txt census_w3d2_20260926_154829.txt
32unprimed164.141.68687822313542123728815784width_ab_20260926_154922.txt census_w3d2_20260926_154922.txt

A5+F4

HEAD A5 0xE4B711A5 + TAIL F4 0xE4B711F4

Embedding fold + burst export: fold off (protocol, ADAPTIVE_TREE, KVI) then fold on

sessiondatetest scriptssettingsverdict
A5F4_PROTOCOL (texts)09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/bringup_a5f4.sh
/home/y344shi/.claude/jobs/5b98fbdb/tmp/a5f4_ladder.sh
pair_image_protocol.sh texts
SGLang 0.5.14; KVI no; FASTGLUE off; backend fa4; 2 armstexts 50/50 vs E1+CF at w2 and w3 (fold OFF); w2 202.46 @1.83, w3 200.60 @1.98 (one round each)
box1 /sanctuary/lab/results/2026-09-26/A5F4_PROTOCOL/protocol_20260926_185402.out
ADAPTIVE_TREE09-26/sanctuary/pdi_inbox/ADAPTIVE_TREE/v3/lab_adaptive_tree.sh (KVI + FASTGLUE=4 v4.2)
score_trace_calib.py
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/a5f4_ladder.sh
SGLang 0.5.16; KVI yes; FASTGLUE v4; backend fa4; 7 armsw2 d2 268.01 @2.55 = new pair best; w1 d2-d5 259.45-244.10; TREE_STOP projected +11.5% (held-out +9.9% / +13.2%) [P] -> launch TREE_STOP TAIL (F9)
from_box1/20260926/ADAPTIVE_TREE/REPORT.md
A5F4_PROTOCOL (mt3, census, grid)09-26pair_image_protocol.sh mt3 census grid primed hum csv
via /home/y344shi/.claude/jobs/5b98fbdb/tmp/a5f4_ladder.sh
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off; backend fa4; 20 armsmt3 done (see cells); census done; grid stopped at arm 14 (w6 d4) when the ladder ended rc=143 at 19:27:18; primed / hum / csv phases NOT run
box1 /sanctuary/lab/results/2026-09-26/A5F4_PROTOCOL/protocol_20260926_190349.out; card_runs.log
A5F4_FOLD09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/a5_fold_kvi.sh
/sanctuary/pdi_inbox/EMBFOLD/host/embfold_session.py (fold-up; failed here)
/sanctuary/pdi_inbox/HOST_GLUE/v4_3 (PART K)
pair_width_ab_kvi.sh
pair_census.sh
SGLang 0.5.16; KVI yes; FASTGLUE v4; backend fa4; 8 arms19:29:46-19:38:01 rc 0. Fold-up FAILED (weights file boot_streams/input_layernorm_g.hex missing) -> PART F skipped, card unfolded. PART K (KVI + FASTGLUE=4 v4.3, fold off): mt w3 d2/3/5/7 + hum w3 d2/5/10/15 ran, KVI PROOF ok on every arm (last hum arm: runner printed NO SUMMARY LINE for the [kvi] summary). A fold retry (a5_fold.sh) followed at 19:38:29
box1 /sanctuary/lab/results/2026-09-26/A5F4_FOLD/fold_kvi_20260926_192946.out
A5F4_FOLD (retry, fold ON)09-26/home/y344shi/.claude/jobs/5b98fbdb/tmp/a5_fold.sh
/sanctuary/pdi_inbox/EMBFOLD/host/embfold_session.py
pair_census.sh
pair_width_ab.sh (ORDER 2 3 3 2 2 3)
SGLang 0.5.14/0.5.16; KVI no; FASTGLUE off; backend fa4; 12 arms19:38:29-19:51:48 rc 0. Fold up OK (lineage view of the weights); fold ON texts 50/50 vs E1+CF at w2 and w3; census + mt3 w2/w3 d2 ran (cells carry the EMBFOLD_TABLE flag); fold status after runs: folded 17,618 items, host_miss 13,172, rresp/rlast err 0
box1 /sanctuary/lab/results/2026-09-26/A5F4_FOLD/fold_20260926_193829.out
A5F4_PROTOCOL (grid, primed, hum; relaunch)09-26pair_image_protocol.sh grid primed hum csv (under card_run.sh, owner box1-hq-a5proto)—RUNNING since 19:52:21 (fold off); cells from this run are not in this catalog unless listed below
box1 /sanctuary/lab/card_runs.log
tok/s vs depth (50×32; hover a point for accept, rounds and source)
0 50 100 150 200 250 300 2 3 4 5 10 15 tree depth d tok/s mt unprimed w3 d2: 201.36 tok/s @ 1.98 accept (n=1; width_ab_20260926_191420.txt) mt unprimed w3 d3: 172.70 tok/s @ 2.09 accept (n=1; width_ab_20260926_191420.txt) mt unprimed w3 d4: 151.38 tok/s @ 2.12 accept (n=1; width_ab_20260926_191420.txt) hum KVI w3 d2: 153.21 tok/s @ 2.89 accept (n=1; width_ab_20260926_193355.txt) hum KVI w3 d5: 153.03 tok/s @ 5.14 accept (n=1; width_ab_20260926_193355.txt) hum KVI w3 d10: 144.67 tok/s @ 7.62 accept (n=1; width_ab_20260926_193355.txt) hum KVI w3 d15: 132.19 tok/s @ 8.99 accept (n=1; width_ab_20260926_193355.txt) mt KVI+FASTGLUE4 w1 d2: 259.45 tok/s @ 2.32 accept (n=1; width_ab_20260926_185929.txt) mt KVI+FASTGLUE4 w1 d3: 259.20 tok/s @ 2.66 accept (n=1; width_ab_20260926_185929.txt) mt KVI+FASTGLUE4 w1 d4: 252.39 tok/s @ 2.87 accept (n=1; width_ab_20260926_185929.txt) mt KVI+FASTGLUE4 w1 d5: 244.10 tok/s @ 3.07 accept (n=1; width_ab_20260926_185929.txt) ■ mt KVI+FASTGLUE4 w1 ■ mt unprimed w3 ■ hum KVI w3
w × d grid — mt_bench KVI, FASTGLUE v4, SGLang 0.5.16, fa4, 50x32, flags: PAIR_SKIP_GPU_EXTEND=0
d \ ww1w2w3
d2259.45@ 2.32 · n=1268.01@ 2.55 · n=1257.72@ 2.61 · n=1
d3259.20@ 2.66 · n=1—247.16@ 3.20 · n=1
d4252.39@ 2.87 · n=1——
d5244.10@ 3.07 · n=1—221.21@ 3.88 · n=1
d7——198.77@ 4.35 · n=1
source: width_ab_20260926_185929.txt, width_ab_20260926_193006.txt
w × d grid — mt_bench unprimed, FASTGLUE off, SGLang 0.5.16, fa4, 50x32
d \ ww2w3w4w6w8
d2204.39@ 1.83 · n=1201.36@ 1.98 · n=1197.47@ 2.06 · n=1183.28@ 2.16 · n=1172.69@ 2.21 · n=1
d3182.43@ 1.93 · n=1172.70@ 2.09 · n=1163.79@ 2.18 · n=1148.97@ 2.28 · n=1129.05@ 2.31 · n=1
d4163.09@ 1.96 · n=1151.38@ 2.12 · n=1140.58@ 2.22 · n=1121.36@ 2.31 · n=1—
source: arm, log, only, width_ab_20260926_191420.txt
Depth ladders and width rows
w3 · humaneval KVI, FASTGLUE v4, SGLang 0.5.16, fa4, 50x32, flags: PAIR_SKIP_GPU_EXTEND=0
d2 153.21 @ 2.89 · n=1d5 153.03 @ 5.14 · n=1d10 144.67 @ 7.62 · n=1d15 132.19 @ 8.99 · n=1
source: width_ab_20260926_193355.txt
d7 · mt_bench KVI, FASTGLUE v4, SGLang 0.5.16, fa4, 50x32, flags: PAIR_SCORE_TRACE=1 PAIR_SKIP_GPU_EXTEND=0
w2 214.76 @ 3.98 · n=1w3 197.03 @ 4.35 · n=1
d2 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.14, fa4, 50x32
w2 202.51 @ 1.83 · n=4w3 201.81 @ 1.98 · n=4
d2 · mt_bench unprimed, FASTGLUE off, SGLang 0.5.14, fa4, 50x32, flags: EMBFOLD_TABLE=/sanctuary/pdi_inbox/EMBFOLD/table_osprey_npc9_c7 EMBFOLD_WEIGHTS=/home/y344shi/.claude/jobs/5b98fbdb/tmp/fold_lineage
w2 203.79 @ 1.83 · n=4w3 203.92 @ 1.98 · n=4
All 41 cells (best-by-cell, with rounds and source)
modebenchreq×newwdcondFGSGLangbackendflagsntok/smin–maxacceptsource
censusmt_bench1×3232primedoff0.5.16fa41132.60132.60–132.602.29width_ab_20260926_191239.txt
censusmt_bench1×3232primedoff0.5.16fa4EMBFOLD_TABLE=/sanctuary/pdi_inbox/EMBFOLD/table_osprey_npc9_c7 EMBFOLD_WEIGHTS=/home/y344shi/.claude/jobs/5b98fbdb/tmp/fold_lineage1130.88130.88–130.882.29width_ab_20260926_194351.txt
censusmt_bench1×3233primedoff0.5.16fa41128.36128.36–128.362.91width_ab_20260926_191011.txt
censusmt_bench1×3233primedoff0.5.16fa4EMBFOLD_TABLE=/sanctuary/pdi_inbox/EMBFOLD/table_osprey_npc9_c7 EMBFOLD_WEIGHTS=/home/y344shi/.claude/jobs/5b98fbdb/tmp/fold_lineage1128.50128.50–128.502.91width_ab_20260926_194124.txt
censusmt_bench1×3232unprimedoff0.5.16fa41177.36177.36–177.361.68width_ab_20260926_191330.txt
censusmt_bench1×3232unprimedoff0.5.16fa4EMBFOLD_TABLE=/sanctuary/pdi_inbox/EMBFOLD/table_osprey_npc9_c7 EMBFOLD_WEIGHTS=/home/y344shi/.claude/jobs/5b98fbdb/tmp/fold_lineage1175.59175.59–175.591.68width_ab_20260926_194441.txt
censusmt_bench1×3233unprimedoff0.5.16fa41137.28137.28–137.281.60width_ab_20260926_191149.txt
censusmt_bench1×3233unprimedoff0.5.16fa4EMBFOLD_TABLE=/sanctuary/pdi_inbox/EMBFOLD/table_osprey_npc9_c7 EMBFOLD_WEIGHTS=/home/y344shi/.claude/jobs/5b98fbdb/tmp/fold_lineage1137.31137.31–137.311.60width_ab_20260926_194301.txt
pairhumaneval50×3232KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01153.21153.21–153.212.89width_ab_20260926_193355.txt
pairhumaneval50×3235KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01153.03153.03–153.035.14width_ab_20260926_193355.txt
pairhumaneval50×32310KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01144.67144.67–144.677.62width_ab_20260926_193355.txt
pairhumaneval50×32315KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01132.19132.19–132.198.99width_ab_20260926_193355.txt
pairmt_bench50×3212KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01259.45259.45–259.452.32width_ab_20260926_185929.txt
pairmt_bench50×3213KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01259.20259.20–259.202.66width_ab_20260926_185929.txt
pairmt_bench50×3214KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01252.39252.39–252.392.87width_ab_20260926_185929.txt
pairmt_bench50×3215KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01244.10244.10–244.103.07width_ab_20260926_185929.txt
pairmt_bench50×3222KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01268.01268.01–268.012.55width_ab_20260926_185929.txt
pairmt_bench50×3227KVIv40.5.16fa4PAIR_SCORE_TRACE=1 PAIR_SKIP_GPU_EXTEND=01214.76214.76–214.763.98width_ab_20260926_185648.txt
pairmt_bench50×3232KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01257.72257.72–257.722.61width_ab_20260926_193006.txt
pairmt_bench50×3233KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01247.16247.16–247.163.20width_ab_20260926_193006.txt
pairmt_bench50×3235KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01221.21221.21–221.213.88width_ab_20260926_193006.txt
pairmt_bench50×3237KVIv40.5.16fa4PAIR_SCORE_TRACE=1 PAIR_SKIP_GPU_EXTEND=01197.03197.03–197.034.35width_ab_20260926_185648.txt
pairmt_bench50×3237KVIv40.5.16fa4PAIR_SKIP_GPU_EXTEND=01198.77198.77–198.774.35width_ab_20260926_193006.txt
pairmt_bench50×3222unprimedoff0.5.14fa44202.51201.48–203.211.83width_ab_20260926_185402.txt width_ab_20260926_190349.txt
pairmt_bench50×3222unprimedoff0.5.14fa4EMBFOLD_TABLE=/sanctuary/pdi_inbox/EMBFOLD/table_osprey_npc9_c7 EMBFOLD_WEIGHTS=/home/y344shi/.claude/jobs/5b98fbdb/tmp/fold_lineage4203.79200.21–207.731.83width_ab_20260926_193848.txt width_ab_20260926_194531.txt
pairmt_bench50×3232unprimedoff0.5.14fa44201.81200.60–203.011.98width_ab_20260926_185402.txt width_ab_20260926_190349.txt
pairmt_bench50×3232unprimedoff0.5.14fa4EMBFOLD_TABLE=/sanctuary/pdi_inbox/EMBFOLD/table_osprey_npc9_c7 EMBFOLD_WEIGHTS=/home/y344shi/.claude/jobs/5b98fbdb/tmp/fold_lineage4203.92201.16–207.231.98width_ab_20260926_193848.txt width_ab_20260926_194531.txt
pairmt_bench50×3222unprimedoff0.5.16fa41204.39204.39–204.391.83width_ab_20260926_191420.txt
pairmt_bench50×3223unprimedoff0.5.16fa41182.43182.43–182.431.93width_ab_20260926_191420.txt
pairmt_bench50×3224unprimedoff0.5.16fa41163.09163.09–163.091.96width_ab_20260926_191420.txt
pairmt_bench50×3232unprimedoff0.5.16fa41201.36201.36–201.361.98width_ab_20260926_191420.txt
pairmt_bench50×3233unprimedoff0.5.16fa41172.70172.70–172.702.09width_ab_20260926_191420.txt
pairmt_bench50×3234unprimedoff0.5.16fa41151.38151.38–151.382.12width_ab_20260926_191420.txt
pairmt_bench50×3242unprimedoff0.5.16fa41197.47197.47–197.472.06width_ab_20260926_191420.txt
pairmt_bench50×3243unprimedoff0.5.16fa41163.79163.79–163.792.18width_ab_20260926_191420.txt
pairmt_bench50×3244unprimedoff0.5.16fa41140.58140.58–140.582.22width_ab_20260926_191420.txt
pairmt_bench50×3262unprimedoff0.5.16fa41183.28183.28–183.282.16width_ab_20260926_191420.txt
pairmt_bench50×3263unprimedoff0.5.16fa41148.97148.97–148.972.28width_ab_20260926_191420.txt
pairmt_bench50×3264unprimedoff0.5.16fa41121.36121.36–121.362.31arm log only
pairmt_bench50×3282unprimedoff0.5.16fa41172.69172.69–172.692.21width_ab_20260926_191420.txt
pairmt_bench50×3283unprimedoff0.5.16fa41129.05129.05–129.052.31width_ab_20260926_191420.txt
Census, 1 request (per-phase cycles)
wdcondtok/sacceptHEAD G4HEAD G5TAIL GLMTAIL TREEsource
33primed128.362.913949330591618125356826518width_ab_20260926_191011.txt census_w3d3_20260926_191010.txt
33unprimed137.281.6023415002862682279201502760width_ab_20260926_191149.txt census_w3d3_20260926_191148.txt
32primed132.602.29357469046938691168601104width_ab_20260926_191239.txt census_w3d2_20260926_191239.txt
32unprimed177.361.681358070158902123728815784width_ab_20260926_191330.txt census_w3d2_20260926_191330.txt
33primed128.502.913499474591618125356826518width_ab_20260926_194124.txt census_w3d3_20260926_194124.txt
33unprimed137.311.6015235802862682279201502760width_ab_20260926_194301.txt census_w3d3_20260926_194301.txt
32primed130.882.29328841846938691168601104width_ab_20260926_194351.txt census_w3d2_20260926_194351.txt
32unprimed175.591.68969558158902123728815784width_ab_20260926_194441.txt census_w3d2_20260926_194441.txt

GPU-only references

SGLang EAGLE on the H200 without the FPGA pair. Rows with a 345 MHz clock had the GPU clock sampled before warm-up.

benchwdbackendreq×newSGLangtok/sacceptclockdatelog
humaneval32fa350×320.5.16422.222.901785MHz09-24hum_fa3_d2_w3_r50n32_20260924_233602.log
humaneval33fa350×320.5.16488.513.861785MHz09-24hum_fa3_d3_w3_r50n32_20260924_233640.log
humaneval35fa350×320.5.16554.655.211785MHz09-24hum_fa3_d5_w3_r50n32_20260924_233719.log
humaneval38fa350×320.5.16569.826.721785MHz09-24hum_fa3_d8_w3_r50n32_20260924_233757.log
humaneval310fa350×320.5.16596.727.841785MHz09-24hum_fa3_d10_w3_r50n32_20260924_233835.log
humaneval315fa350×320.5.16606.279.251785MHz09-24hum_fa3_d15_w3_r50n32_20260924_233912.log
humaneval22fa480×10240.5.16471.592.83345MHz09-24hum_fa4_d2_w2_20260924_155854.log
humaneval23fa480×10240.5.16461.593.61345MHz09-24hum_fa4_d3_w2_20260924_160049.log
humaneval32fa450×320.5.16242.772.90345MHz09-24hum_fa4_d2_w3_r50n32_20260924_233102.log
humaneval33fa450×320.5.16264.053.751785MHz09-24hum_fa4_d3_w3_r50n32_20260924_233156.log
humaneval35fa450×320.5.16278.374.981785MHz09-24hum_fa4_d5_w3_r50n32_20260924_233247.log
humaneval38fa450×320.5.16281.996.251785MHz09-24hum_fa4_d8_w3_r50n32_20260924_233335.log
humaneval310fa450×320.5.16276.276.431785MHz09-24hum_fa4_d10_w3_r50n32_20260924_233424.log
humaneval315fa450×320.5.16273.497.411785MHz09-24hum_fa4_d15_w3_r50n32_20260924_233513.log
mt_bench32fa350×320.5.16401.392.671785MHz09-25mt_fa3_d2_w3_r50n32_20260925_000416.log
mt_bench33fa350×320.5.16436.133.291785MHz09-25mt_fa3_d3_w3_r50n32_20260925_000455.log
mt_bench34fa350×320.5.16435.443.651785MHz09-25mt_fa3_d4_w3_r50n32_20260925_000534.log
mt_bench35fa350×320.5.16449.683.971785MHz09-25mt_fa3_d5_w3_r50n32_20260925_000612.log
mt_bench36fa350×320.5.16441.944.201785MHz09-25mt_fa3_d6_w3_r50n32_20260925_000650.log
mt_bench37fa350×320.5.16445.134.511785MHz09-25mt_fa3_d7_w3_r50n32_20260925_000729.log
mt_bench32fa450×320.5.16392.232.641785MHz09-24mt_fa4_d2_w3_r50n32_20260924_235936.log
mt_bench33fa450×320.5.16429.133.201785MHz09-25mt_fa4_d3_w3_r50n32_20260925_000022.log
mt_bench34fa450×320.5.16437.003.551785MHz09-25mt_fa4_d4_w3_r50n32_20260925_000109.log
mt_bench35fa450×320.5.16446.583.861785MHz09-25mt_fa4_d5_w3_r50n32_20260925_000156.log
mt_bench36fa450×320.5.16427.894.021785MHz09-25mt_fa4_d6_w3_r50n32_20260925_000242.log
mt_bench37fa450×320.5.16433.194.201785MHz09-25mt_fa4_d7_w3_r50n32_20260925_000329.log