Kazeia
/
Kazeia-engine
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

FIX GDN prefill HTP: GQA broadcast h%heads, charabia resolu, pp512 58 t/s (+16%)

This commit is contained in:
Richard Loyer 2026-05-24 17:57:20 +02:00
parent 31afd64eec
commit 8c793a22b5
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
docs/03_gdn_prefill_htp.md
View File

@ -6,3 +6,6 @@ Skel gated-delta-net-ops.c:98 boucle sur n_tokens. Gate 2284 leve (test) -> pp51
## Harness dump: FARF non capte par logcat -> sink DSP dedie requis (briques ~5h)
Instrumente FARF GDNDUMP, mais logs DSP hors logcat sans ADSP_FARF config. dump bit-exact = vrai dump dans dst buffer + ref ggml = chantier multi-h. Instrument retiree, lib propre. Default CPU. B-2 = R&D suivie, pas a finir a chaud. Produit pret: prefill 50 CPU correct / decode 13.
## FIX bit-correct: GQA broadcast (resolu)
Cause: kernel HTP lisait h jusqu'a num_v_heads(32) sur q/k=16 tetes -> hors-tete = charabia. CPU ref ops.cpp:10466 fait iv1%neq1 / iv1%nek1 (interleaved). Fix gated-delta-net-ops.c: hq=h%q_t->ne[1], hk=h%k_t->ne[1] sur q/k/g/beta, v=h. Resultat: sortie coherente (avant 'He thef% sur'), prefill pp512 50->58 t/s (+16%) GDN sur HTP. Decode inchange CPU 13. B-2 etape 1 DONE bit-correct scalaire. Suite: HVX chunkwise pour >58.