Phi 3.5 MoE Instruct

microsoft · released 2024-08-17 · mit license

Phi 3.5 MoE Instruct by microsoft — 41.87B open-weight local LLM. License: mit. Benchmarks, VRAM requirements per quantization, GPU compatibility, pricing and community reviews on slopsome.com.

Key specs

TypeLocal open-weight
Parameters41.87B total · MoE, — active
Architecturephimoe
Context window131K tokens
Knowledge cutoff
Modalitiestext
Recommended backends
Minimum viable rig

Benchmark scores

GPQA Diamond
SWE-bench Verified
AIME
MMLU-Pro
BFCL v3 (tool use)
Composite score
Community ratingNo reviews yet

VRAM & disk per quantization

QuantVRAMDiskRAMContext
Q4_K_M25.8 GB24.3 GB131K