Qwen1.5 MoE A2.7B

Qwen · released 2024-02-29 · other license

Qwen1.5 MoE A2.7B by Qwen — 14.32B open-weight local LLM. License: other. Benchmarks, VRAM requirements per quantization, GPU compatibility, pricing and community reviews on slopsome.com.

Key specs

TypeLocal open-weight
Parameters14.32B total · MoE, — active
Architectureqwen2_moe
Context window8K tokens
Knowledge cutoff
Modalitiestext
Recommended backends
Minimum viable rig

Benchmark scores

GPQA Diamond
SWE-bench Verified
AIME
MMLU-Pro
BFCL v3 (tool use)
Composite score
Community ratingNo reviews yet

VRAM & disk per quantization

QuantVRAMDiskRAMContext
Q4_K_M9.8 GB8.3 GB8K