localbench

localbench

Gemma 4 E4B GGUF Quality Benchmark: unsloth, bartowski, lmstudio-community, ggml-org, mradermacher compared

62 GGUF quants benchmarked against BF16, ranked by KL divergence

oobabooga's avatar
oobabooga
Apr 14, 2026
∙ Paid

Repos tested

62 GGUF quants from 5 uploaders, measured by KL divergence against the BF16 reference using ~250,000 tokens of coding, chat, tool calling, science, non-Latin scripts, and long documents. Full methodology.

  • unsloth/gemma-4-E4B-it-GGUF (20 quants)

  • bartowski/google_gemma-4-E4B-it-GGUF (22 quants)

  • lmstudio-community/gemma-4-E4B-it-GGUF (3 quants)

  • ggml-org/gemma-4-E4B-it-GGUF (2 quants)

  • mradermacher/gemma-4-E4B-it-i1-GGUF (15 quants)

Results

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2026 localbench · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture