Llama 3.1 8B Instruct

unsloth · released 2025-02-15 · llama3.1 license

Llama 3.1 8B Instruct by unsloth — 8.03B open-weight local LLM. License: llama3.1. Benchmarks, VRAM requirements per quantization, GPU compatibility, pricing and community reviews on slopsome.com.

Key specs

TypeLocal open-weight
Parameters8.03B total
Architecturellama
Context window131K tokens
Knowledge cutoff
Modalitiestext
Recommended backends
Minimum viable rig

Benchmark scores

GPQA Diamond
SWE-bench Verified
AIME
MMLU-Pro
BFCL v3 (tool use)
Composite score
Community ratingNo reviews yet

VRAM & disk per quantization

QuantVRAMDiskRAMContext
Q4_K_M6.2 GB4.7 GB131K