Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,070

Base only

Active filters: 4bit

orcarouter/Qwen3.8-Flash-Next-Uncensored-MLX

Image-Text-to-Text • 71B • Updated 1 day ago • 27

mlx-community/Qwen3.8-27B-Uncensored-OptiQ-4bit

Text Generation • 5B • Updated 4 days ago • 398 • 6

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated Jul 14 • 9.66k • 71

mlx-community/Qwen3.8-27B-OBLITERATED-OptiQ-4bit

Image-Text-to-Text • 6B • Updated 4 days ago • 629 • 4

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated Mar 2 • 26.2k • 38

mlx-community/Qwen3.8-27B-OptiQ-4bit

Image-Text-to-Text • 6B • Updated 12 days ago • 9.4k • 15

MIRALABS/Ornith-1.5-35B-A3B-W4A16-SYM

Image-Text-to-Text • 36B • Updated 7 days ago • 776 • 3

mlx-community/Ornith-1.5-35B-A3B-OptiQ-4bit

Image-Text-to-Text • 7B • Updated 4 days ago • 389 • 3

groxaxo/Qwen3.8-27B-abliterated-GPTQ-Pro

Text Generation • 28B • Updated 7 days ago • 281 • 2

mlx-community/Ornith-1.5-9B-OptiQ-4bit

Text Generation • 2B • Updated 3 days ago • 105 • 2

marksverdhai/vibevoice-7b-bnb-4bit

Text-to-Speech • 10B • Updated Dec 31, 2025 • 154 • 8

Runpod/FLUX.2-klein-4B-mflux-4bit

Text-to-Image • Updated Apr 10 • 23.3k • 10

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 26.1k • 158

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated Jul 14 • 10.8k • 97

appautomaton/openmoss-sound-effect-mlx

Text-to-Audio • Updated 23 days ago • 2

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 11.3k • 289

majentik/fishaudio-s2-pro-MLX-4bit

Text-to-Speech • 0.7B • Updated Apr 17 • 133 • 5

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated Jul 14 • 6.59k • 78

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated Jul 20 • 2.8k • 19

AxisQuant/Qwen3.6-27b-gptq-int4

Text Generation • 27B • Updated Jul 2 • 3.9k • 6

Reza2kn/mega-asr-nvfp4

Automatic Speech Recognition • Updated May 22 • 1

pnoid/Mistral-Small-3.2-24B-OpenThoughts-Distill-v1-mlx-4bit

Text Generation • 24B • Updated Jun 2 • 55 • 1

mlx-community/gemma-4-26B-A4B-it-qat-assistant-4bit

Text Generation • 65.6M • Updated Jun 5 • 719 • 2

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated Jul 20 • 2.98k • 15

fe-dev-dl/Ornith-1.0-9B-Hardware-Expert-fp16

Text Generation • 9B • Updated Jul 15 • 109 • 4

mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit

Text Generation • 0.2B • Updated Jul 14 • 1.55k • 6

Alluringcfdbgfhgdnufvhg/Qwen3.5-2B-JP

2B • Updated 7 days ago • 54 • 1

mlx-community/Qwythos-27B-v1-OptiQ-4bit

Image-Text-to-Text • 27B • Updated 26 days ago • 341 • 1

mlx-community/Tiny-Pickle-v3-Coder-4bit

Text Generation • 5B • Updated 22 days ago • 103 • 1

mlx-community/Muse-Glimmer-30B-OptiQ-4bit

Image-Text-to-Text • 7B • Updated 15 days ago • 1.61k • 5