Kazeia
/
Kazeia-engine
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
98 Commits 1 Branch 0 Tags 217 MiB
Shell 100%
Go to file
Richard Loyer a5d591a07b doc: PERF_CPU_OPTIMS.md — bilan optims CPU, RTF 2.93->2.45 
Synthèse de 6 stratégies CPU testées systématiquement :
  T1.bench profile fin    : ggml_init=0ms, copies gratuites, delta 24ms = sample_head
  T1.1 thread sweep       : T=6 G=8 optimal, T=8 catastrophe (RTF 40+)
  T1.2 affinity taskset   : Android tatillon, masks restrictifs freezent
  T2.1 NEON heads 16-way  : -33% CP, -16% pipeline, BIT-EXACT  <- GROS GAIN
  T2.2 threadpool persist : estimé 0.15% gain, skipped
  T1.3 ctx réutilisé      : invalidé par profile (init=0ms)

État final RTF 2.45 stable sur 3 phrases (33/41/60 frames). Decoder
maintenant 49% du total. Plafond CPU pur atteint sans toucher kernel.

Leviers résiduels :
- Streaming pipeline (1 session) : seul gain UX disponible, TTFB ~500ms
- Decoder fine optim : < 5% potentiel additionnel
- RTF<1 = chantier kernel hexagon ou Vulkan, hors scope CPU

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 		2026-05-29 17:30:54 +02:00
.claude Rapport R&D complet: synthese session, perf, cascade, #277, briques, reste a faire 2026-05-25 22:27:34 +02:00
dist doc: PERF_CPU_OPTIMS.md — bilan optims CPU, RTF 2.93->2.45 2026-05-29 17:30:54 +02:00
docs GDN chunkwise P1.2: VTCM state prefill=neutre, prouve compute-bound 3S2/tok -> gain=WY matmul (palier dur). oracle 28/28, pp98 2026-05-26 16:30:08 +02:00
eval eval: verdict (assisté, à valider) -> ship Qwen3.5-lmq4 2026-05-26 23:23:00 +02:00
ql@6e0edba837 ql: bump pour qwen3 dense IMROPE (ql:6e0edba) 2026-05-28 13:54:27 +02:00
.gitignore eval: kit qualité A/B aveugle Qwen3.5-lmq4 vs dense (decode CPU, template, reasoning off) 2026-05-26 22:24:23 +02:00
CHANTIER_HMX_DENSE.md chantier dense-HMX #4: 0x2e décodé = AEE_ECONNRESET (reset watchdog CDSP), pas une corruption de valeurs 2026-05-27 19:20:28 +02:00
CLAUDE.md R&D: battre pte=lm_head HMX INT4+spec decode+ctx binary; mur=lm_head CPU 2026-05-25 18:46:28 +02:00
RAPPORT_RD.md RAPPORT §7: piste kernel GDN fermee — GDN-compute != goulot prefill (fork ql) 2026-05-26 21:46:05 +02:00
c4.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00
casc.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00
casc2.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00
casc3.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00
cascade_test.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00
cf.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00
qcmp.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00
spk.sh Dist Kazeia-Engine: libs arm64+headers+JNI bridge+INTEGRATION/TTS doc; STT reste ORT 2026-05-24 21:55:01 +02:00