Richard Loyer
|
eb72df4767
|
Mesure split ref: prefill HTP 55 / decode CPU 15 Qwen3.5-4B, end-to-end ~13s
|
2026-05-24 18:08:39 +02:00 |
|
Richard Loyer
|
1b64bbb7eb
|
Clarif: gen lente = decode-NPU cli, pas GDN; split prefill-NPU/decode-CPU = role JNI
|
2026-05-24 18:06:40 +02:00 |
|
Richard Loyer
|
8c793a22b5
|
FIX GDN prefill HTP: GQA broadcast h%heads, charabia resolu, pp512 58 t/s (+16%)
|
2026-05-24 17:57:20 +02:00 |
|
Richard Loyer
|
31afd64eec
|
GDN dump: FARF hors logcat (sink dedie req), lib nettoyee, B-2 tracke. Produit 50/13 pret
|
2026-05-24 17:42:34 +02:00 |
|
Richard Loyer
|
6e63110f8a
|
GDN prefill: bug=handoff multi-token (pas GQA), fix=dump bisection; defaut CPU sur
|
2026-05-24 17:38:35 +02:00 |
|
Richard Loyer
|
33e848be3c
|
Chantier 3: gate GDN-prefill leve = charabia, +11% INVALIDE, defaut CPU. Honnete: kernel a fixer
|
2026-05-24 17:22:52 +02:00 |
|
Richard Loyer
|
b82420fd46
|
Chantier 3 etape 1: GDN prefill HTP, gate leve, pp512 +11% (50->55)
|
2026-05-24 17:20:09 +02:00 |
|
Richard Loyer
|
ae842df5ae
|
Chantier 2 clos: CONT low-ROI (opsync gonfle, reshape structurel) -> 3 prioritaire
|
2026-05-24 17:17:24 +02:00 |
|
Richard Loyer
|
104c6b4ad5
|
CLAUDE: chantier1 clos
|
2026-05-24 17:16:44 +02:00 |
|
Richard Loyer
|
024f3b8ed6
|
Chantier 1 clos: prefill pp2048 sain (46t/s), hang=cli only hors JNI
|
2026-05-24 17:16:44 +02:00 |
|
Richard Loyer
|
17a78f1c6a
|
Profil: GDN absent HTP (100% CPU confirme), CONT+SSM_CONV+MULMAT dominent; lib restauree
|
2026-05-24 16:53:08 +02:00 |
|
Richard Loyer
|
3a5f735ab9
|
Optim prefill: ngl99/t8/b512=49.9 t/s (+11%), full offload, decode CPU
|
2026-05-24 16:35:52 +02:00 |
|
Richard Loyer
|
627f9a80e2
|
Correctif: OPFILTER inexistant, isolation GDN_cpu = bench DEBUG; bugs+qualite requalifies
|
2026-05-24 15:58:18 +02:00 |
|
Richard Loyer
|
d05483b13a
|
Bug cli = overflow buffer HTP gros prefill (2^44), pas init; qualite 4B OK
|
2026-05-24 15:52:33 +02:00 |
|
Richard Loyer
|
753d8be2b0
|
pp1024 plat (saturation batchable), bornes GDN: cout B-2 non mesure, profiler bloque par cli
|
2026-05-24 15:44:45 +02:00 |
|
Richard Loyer
|
4dd863ecb5
|
Verdict: GDN HTP decode-only (2284), prefill GDN fallback CPU = ancre. B chiffre.
|
2026-05-24 14:49:39 +02:00 |
|
Richard Loyer
|
eceacaba9a
|
Mesures 4B: HTP prefill 44 / CPU decode 13.4, qwen35_compile HTP fonctionne
|
2026-05-24 14:33:17 +02:00 |
|
Richard Loyer
|
2779babcab
|
Rebuild upstream+hexagon: configure OK (NDK r27d, SDK 6.5, v79), build lance
|
2026-05-24 13:01:16 +02:00 |
|
Richard Loyer
|
6aa4d06c95
|
Ambition haute: cible = Qwen3.5-4B near-ExecuTorch, prefill GDN sur HTP, decode CPU
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-24 12:57:37 +02:00 |
|
Richard Loyer
|
12217d3bbc
|
Decision A: integration produit, base upstream master, pas de kernel GDN custom
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-24 12:54:28 +02:00 |
|
Richard Loyer
|
376b4a4a70
|
Angle revise: base upstream master (pas chraac), trou unique = prefill GDN Hexagon
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-24 12:52:08 +02:00 |
|
Richard Loyer
|
cc5b033762
|
Engine cadrage: CLAUDE.md analyse R&D, verdict NPU-prefill/CPU-decode
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-24 12:34:14 +02:00 |