Empreinte: engine GGUF 2.4/5.0 vs pte 3.3/5.9, -15-30%
This commit is contained in:
parent
9f7bc1e6c3
commit
1024167bdc
|
|
@ -96,3 +96,6 @@ BUG=enable_thinking default true -> /no_think ignore -> ramble anglais. FIX: --r
|
|||
|
||||
## Comparatif FR reel (budget0, HTP, pty) 24/05
|
||||
9B>4B net: 9B posture psy juste+empathie; 4B inverse role/sentences generiques. Engine OK, FR coherent. Capture: adb direct=pty -> -st marche; script=pas tty. Reco 9B speaker. Thinker bullets + system bref a brancher pour cadrer. JNI = vrai pipeline.
|
||||
|
||||
## Empreinte .pte vs engine
|
||||
4B: pte 3.3GB/~4.4ION vs engine 2.4GB (-30%). 8/9B: pte8B 5.9GB vs engine9B 5.0GB (-15%). 9B inexistant en pte. GGUF mmap pageable, pte=tout ION 3.5GB/sess. Cascade 9B+Guard4B engine 7.5 vs pte ~10. Engine + leger + flexible.
|
||||
|
|
|
|||
Loading…
Reference in New Issue