Granite 3.1 8B

IBM · Granite family · released 2024-12-18 · Apache-2.0 license

Granite 3.1 8B by IBM — 8B open-weight local LLM. License: Apache-2.0. Benchmarks, VRAM requirements per quantization, GPU compatibility, pricing and community reviews on slopsome.com.

Key specs

TypeLocal open-weight
Parameters8B total
Architecture
Context window131K tokens
Knowledge cutoff
Modalitiestext
Recommended backends
Minimum viable rig

Benchmark scores

GPQA Diamond32%
SWE-bench Verified20%
AIME30%
MMLU-Pro52%
BFCL v3 (tool use)70%
Composite score12.98
Community ratingNo reviews yet

VRAM & disk per quantization

QuantVRAMDiskRAMContext
Q4_K_M6 GB5 GB8 GB131K