Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

159

Base only

Active filters: ik_llama.cpp

ubergarm/GLM-5.1-GGUF

Text Generation • 754B • Updated Apr 9 • 63 • 25

AlexanderKyng/Mistral-Small-119B-2603-ik-GGUF

Text Generation • 119B • Updated Apr 11 • 20

sokann/GLM-5.1-GGUF-1.673bpw

754B • Updated Apr 12 • 3.99k • 4

ubergarm/MiniMax-M2.7-GGUF

Text Generation • 229B • Updated Apr 15 • 89 • 21

KeinNiemand/Qwen3.5-122B-A10B-abliterix-IK_GGUF

Text Generation • 122B • Updated Apr 14 • 67 • 2

fanwe/CoPaw-Flash-9B-DataAnalyst-GGUF

Updated Apr 19 • 1

ubergarm/Kimi-K2.6-GGUF

Text Generation • 1T • Updated Apr 27 • 179 • 38

RDson/Qwen3.6-27B-IQ4_KS-GGUF

Text Generation • 27B • Updated Apr 23 • 20 • 3

sokann/Qwen3.6-27B-GGUF-5.076bpw

27B • Updated Apr 26 • 10 • 6

sokann/Qwen3.6-27B-GGUF-4.256bpw

27B • Updated Apr 30 • 477 • 16

sokann/Qwen3.6-27B-GGUF-4.262bpw

27B • Updated Apr 30 • 94 • 5

RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF

Text Generation • 27B • Updated May 2 • 143 • 7

sandeshrajx/Qwen3.6-27B-MTP-Q3_K_S-GGUF

Text Generation • 27B • Updated May 7 • 2.63k • 1

cafkafk/gemma-4-E2B-it-assistant-GGUF-noimatrix

78M • Updated May 8 • 402 • 2

cafkafk/gemma-4-E4B-it-assistant-GGUF-noimatrix

78.8M • Updated May 8 • 200 • 3

cafkafk/gemma-4-26B-A4B-it-assistant-GGUF-noimatrix

0.4B • Updated May 8 • 325 • 2

cafkafk/gemma-4-31B-it-assistant-GGUF-noimatrix

0.5B • Updated May 8 • 183 • 8

AlexanderKyng/Qwen3.6-27B-MTP-Custom-IQ6_K

Image-Text-to-Text • 0.5B • Updated May 12 • 42 • 1

ji-farthing/gemma-4-26B-A4B-it-assistant-Q4_K_S-GGUF

0.4B • Updated May 13 • 65

ji-farthing/gemma-4-26B-A4B-it-assistant-Q6_K-GGUF

0.4B • Updated May 13 • 54 • 1

AlexanderKyng/Qwen3.6-35B-A3B-MTP-Mixed-Q8_0

Image-Text-to-Text • 36B • Updated May 17 • 138

gghfez/MiMo-V2.5-ikllama-GGUF

309B • Updated 23 days ago • 308 • 4

weiweisky/Qwen3.6-27B-GGUF-4.256bpw

27B • Updated May 21 • 8

KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF

Text Generation • 8B • Updated Jun 17 • 98

rafw007/qwen36-a3b-claude-coder-llama.cpp-GGUF

Text Generation • 36B • Updated Jun 7 • 1.92k • 8

ji-farthing/North-Mini-Code-1.0-ik-llama-validation-GGUF

31B • Updated Jun 10 • 120

Radamanthys11/Gemma-4-26B-A4B-it-DFlash-GGUF

Text Generation • 0.4B • Updated Jun 15 • 202

Radamanthys11/Gemma-4-31B-it-DFlash-GGUF

Text Generation • 2B • Updated Jun 15 • 246

Radamanthys11/Qwen3.5-122B-A10B-DFlash-GGUF

Text Generation • 0.5B • Updated Jun 15 • 732 • 2

Radamanthys11/Qwen3.6-35B-A3B-DFlash-GGUF

Text Generation • 0.5B • Updated Jun 15 • 175