Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

632

Base only

Active filters: compression

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-qqp-v2

Updated Jul 31, 2022 • 23

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-qqp-v2

Updated Jul 31, 2022 • 38

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • 6B • Updated Jan 10, 2025 • 23 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • 6B • Updated Dec 25, 2024 • 20 • 5

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 19

RedHatAI/sst2-distilbert-sparse-blog

Text Classification • Updated Mar 13, 2024 • 17 • 4

aoxo/kevin-token-compressor

Text Generation • Updated Sep 18, 2024 • 5

justuswill/UQDM

Updated Jun 18, 2025

kalsy/TEZip

Updated Jun 24, 2025

prompterminal/nanogpt-shakespeare-compressed

Text Generation • Updated Jul 21, 2025 • 7

prompterminal/nanogpt-enwik8-compressed

Text Generation • Updated Jul 21, 2025 • 6

prompterminal/nanogpt-enwik8-compressed-working

Text Generation • Updated Jul 21, 2025 • 8 • 1

haichaozhang/VQ-Token-llava-ov-0.5b

Video-Text-to-Text • 1B • Updated Sep 21, 2025 • 50 • 2

qep/qep-1bit-extreme

Text Generation • 23B • Updated Sep 8, 2025 • 17 • 15

swayamsingal/tencent-Hunyuan-MT-7B-light-nanoquant-light

8B • Updated Sep 3, 2025 • 3 • 1

swayamsingal/tencent-Hunyuan-MT-7B-medium-nanoquant-medium

8B • Updated Sep 3, 2025 • 4

kyne0127/Qwen3-30B-A3B-TopK4-Compressed

Text Generation • 31B • Updated Sep 22, 2025 • 12

mradermacher/Qwen3-30B-A3B-TopK4-Compressed-GGUF

31B • Updated Sep 28, 2025 • 184

mradermacher/Qwen3-30B-A3B-TopK4-Compressed-i1-GGUF

31B • Updated Dec 8, 2025 • 567

ggunio/B2NL-v6.1.2

Updated Sep 26, 2025 • 3

ggunio/B2NL-IntelligentTokenizer-v6.2.1

0.2B • Updated Oct 7, 2025 • 15

cerebras/Qwen3-Coder-REAP-363B-A35B-FP8

Text Generation • 363B • Updated Oct 14, 2025 • 42 • 16

cerebras/Qwen3-Coder-REAP-246B-A35B-FP8

Text Generation • 246B • Updated Oct 14, 2025 • 54 • 22

huawei-csl/Qwen3-1.7B-3bit-SINQ

Text Generation • 0.5B • Updated Feb 2 • 25 • 7

huawei-csl/Qwen3-1.7B-3bit-ASINQ

Text Generation • 0.5B • Updated Feb 2 • 20 • 7

huawei-csl/Qwen3-14B-3bit-SINQ

Text Generation • 3B • Updated Feb 2 • 16 • 5

huawei-csl/Qwen3-14B-3bit-ASINQ

Text Generation • 3B • Updated Feb 2 • 13 • 5

huawei-csl/Qwen3-32B-3bit-SINQ

Text Generation • 6B • Updated Feb 2 • 9 • 6

huawei-csl/Qwen3-32B-3bit-ASINQ

Text Generation • 6B • Updated Feb 2 • 24 • 5

huawei-csl/Qwen3-1.7B-4bit-SINQ

Text Generation • 1B • Updated Feb 2 • 20 • 5