Wednesday, June 10, 2026

Gemma 4 12B vs Ministral 14B: Who Wins at Structured Table Extraction?

Head-to-head test: Gemma 4 12B vs Ministral 14B on structured table extraction.

In this video, I run a head-to-head test: Gemma 4 12B (8-bit and bf16) vs Ministral 14B (8-bit), extracting data from a 5-row table — two columns, JSON schema, array output.

Results:

  • Gemma 4 12B (both quantizations): fails to return a proper JSON array
  • Ministral 14B 8-bit: extracts all rows correctly

No comments: