Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,449

Base only

Active filters: llama-cpp

itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

3B • Updated Dec 19, 2024 • 169 • 2

AlicanKiraz0/Seneca-Cybersecurity-LLM-Q4_K_M-GGUF

8B • Updated Mar 15, 2025 • 312 • 41

localattention/ShowUI-2B-Q4_K_M-GGUF

2B • Updated Jan 9, 2025 • 187 • 3

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 8 • 1

mitkox/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

8B • Updated Jan 20, 2025 • 371 • 3

matrixportalx/Dolphin3.0-Llama3.1-8B-GGUF

8B • Updated Jan 20, 2025 • 136 • 1

aiplatforms/ru-uncensored-v2-gguf

Text Generation • 12B • Updated May 7 • 1.32k • 8

asuglia/Qwen2-VL-2B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 2B • Updated Mar 10, 2025 • 733 • 4

typhoon-ai/typhoon2.1-gemma3-12b-gguf

Text Generation • 12B • Updated Jun 11 • 305 • 5

POWERHACK/Qwen3-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated May 10, 2025 • 852 • 1

Manojb/Qwen3-4b-toolcall-gguf-llamacpp-codex

Text Generation • 4B • Updated Sep 25, 2025 • 1.01k • 9

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 20 • 6

vito95311/Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16

Text Generation • 16B • Updated Sep 28, 2025 • 337 • 19

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 35.2k • 25

AXONVERTEX-AI-RESEARCH/Qwen3-VL-4B-Instruct-Q8_0-GGUF

Image-Text-to-Text • 4B • Updated Nov 1, 2025 • 29 • 1

mauroneto/Jurema-7B-Q4_K_M-GGUF

8B • Updated Nov 8, 2025 • 319 • 6

mauroneto/Jurema-7B-Q8_0-GGUF

8B • Updated Nov 8, 2025 • 56 • 2

infil00p/shieldgemma-2-4b-it-GGUF

Image Classification • 4B • Updated Nov 15, 2025 • 1.09k • 2

Edge-Quant/GLM-4.6V-Flash-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Dec 8, 2025 • 1.35k • 1

t-tech/T-pro-it-2.1-GGUF

33B • Updated Dec 23, 2025 • 1.24k • 9

wasirmen123/GLM-Z1-32B-0414-Q5_K_M-GGUF

Text Generation • 33B • Updated Jan 5 • 33 • 2

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model-mlx-8Bit

15B • Updated Jan 16 • 14 • 13

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 143 • 5

jwest33/ministral-3-3b-instruct-2512-null-space-abliterated-GGUF

Image-Text-to-Text • 4B • Updated Jan 21 • 395 • 4

audarai/Audar-TTS-V1-Turbo

Text-to-Speech • 2B • Updated 6 days ago • 166 • 2

intrect/VELA

Text Generation • 8B • Updated Apr 1 • 234 • 3

EMD123/DictaLM-3.0-1.7B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Feb 3 • 74 • 2

TaidanaHito/STORM-Qwen3-4B-Q4_K_M-GGUF

4B • Updated Feb 3 • 18 • 1

aldigobbler/stt-qwen3-1.7b-merged-GGUF

Text Generation • 2B • Updated Feb 13 • 45 • 2

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 2.42k • 9