Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,447

Full-text search

Active filters: 6-bit

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 181k • 10

inferencerlabs/GLM-5-MLX-5.6bit

Text Generation • Updated 12 days ago • 1.95k • 3

steampunque/JoyAI-LLM-Flash-MP-GGUF

49B • Updated 3 days ago • 340 • 2

LiquidAI/LFM2-24B-A2B-MLX-6bit

Text Generation • 24B • Updated 1 day ago • 10 • 2

MaziyarPanahi/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Feb 4, 2024 • 302 • 2

MaziyarPanahi/Hermes-2-Pro-Llama-3-13B-GGUF

Text Generation • 12B • Updated Jun 15, 2024 • 99 • 1

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • 15B • Updated Dec 6, 2024 • 192 • 6

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 109k • 6

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 111k • 16

nightmedia/Qwen3-Next-80B-A3B-Instruct-1M-qx64n-mlx

Text Generation • 80B • Updated Oct 25, 2025 • 51 • 2

nightmedia/Qwen3-Next-80B-A3B-Thinking-1M-qx64n-mlx

Text Generation • 80B • Updated Oct 25, 2025 • 44 • 2

nightmedia/Qwen3-Next-80B-A3B-Instruct-1M-qx64n-hi-mlx

Text Generation • 80B • Updated Nov 17, 2025 • 41 • 1

nightmedia/Qwen3-Next-80B-A3B-Instruct-512K-11e-qx65n-mlx

Text Generation • 80B • Updated Nov 17, 2025 • 36 • 1

MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF

Text Generation • 21B • Updated Nov 28, 2025 • 57.2k • 2

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 58.4k • 3

inferencerlabs/Qwen3-235B-A22B-Instruct-2507-MLX-6.5bit

Text Generation • 235B • Updated Dec 19, 2025 • 75 • 1

mlx-community/LFM2.5-VL-1.6B-6bit

Image-Text-to-Text • 0.7B • Updated Jan 6 • 13 • 1

lmstudio-community/LFM2.5-VL-1.6B-MLX-6bit

Image-Text-to-Text • 0.7B • Updated Jan 8 • 186 • 1

lmstudio-community/GLM-4.7-Flash-MLX-6bit

Text Generation • 30B • Updated Jan 22 • 1.2M • 8

mlx-community/LongCat-Flash-Lite-6bit

Text Generation • 69B • Updated 27 days ago • 89 • 2

DeathGodlike/Naphula_Goetia-24B-v1.3_EXL3

Text Generation • Updated 14 days ago • 7 • 1

mlx-community/MiniMax-M2.5-6bit

Text Generation • 229B • Updated 12 days ago • 678 • 3

mlx-community/XortronCriminalComputingConfig-6bit

Text Generation • 24B • Updated 7 days ago • 63 • 1

inferencerlabs/Ling-2.5-1T-MLX-3.7bit

Text Generation • 1T • Updated about 16 hours ago • 423 • 1

inferencerlabs/INTELLECT-3.1-MLX-7bit

Text Generation • 107B • Updated 1 day ago • 89 • 1

lmstudio-community/LFM2-24B-A2B-MLX-6bit

Text Generation • 24B • Updated 2 days ago • 30.3k • 1

mlx-community/Qwen3.5-27B-6bit

Image-Text-to-Text • 6B • Updated about 21 hours ago • 447 • 1

nightmedia/Qwen3.5-35B-A3B-Text-qx64-hi-mlx

Text Generation • 35B • Updated about 16 hours ago • 202 • 1

nightmedia/Qwen3.5-122B-A10B-Text-qx64-hi-mlx

Text Generation • 122B • Updated about 11 hours ago • 1

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 1 • 1