SmolLM 1.7B Instruct Quantized.W4a16

nm-testing · released 2024-08-23 · apache-2.0 license

SmolLM 1.7B Instruct Quantized.W4a16 by nm-testing — 1.84B open-weight local LLM. License: apache-2.0. Benchmarks, VRAM requirements per quantization, GPU compatibility, pricing and community reviews on slopsome.com.

Key specs

TypeLocal open-weight
Parameters1.84B total
Architecturellama
Context window2K tokens
Knowledge cutoff
Modalitiestext
Recommended backends
Minimum viable rig

Benchmark scores

GPQA Diamond
SWE-bench Verified
AIME
MMLU-Pro
BFCL v3 (tool use)
Composite score
Community ratingNo reviews yet

VRAM & disk per quantization

QuantVRAMDiskRAMContext
Q4_K_M2.6 GB1.1 GB2K