Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,944

Base only

Active filters: bitsandbytes

unsloth/Qwen3.8-27B-unsloth-bnb-4bit

27B • Updated 8 days ago • 115k • 11

milan33/Qwen-Image-Edit-2511-INT4-Diffusers

Image-to-Image • Updated 4 days ago • 18 • 2

shidowake/gemma-7b-base-bnb-4bit

Text Generation • 9B • Updated Feb 23, 2024 • 41 • 1

miguel-kjh/pythia-70m_instruction_code_tuning

Text Generation • 70.7M • Updated Jul 3, 2024 • 52 • 1

miguel-kjh/phi-2_instruction_code_tuning

Text Generation • 3B • Updated Jul 5, 2024 • 45 • 1

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Feb 15, 2025 • 100k • 103

hhamxa678/Llama-3-8b-chat-finetune

Text Generation • 8B • Updated Aug 14, 2024 • 43 • 1

winglian/llama-3.1-8b-talk-like-a-pirate

Updated Sep 24, 2024 • 7 • 2

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Jun 2, 2025 • 40k • 37

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • 11B • Updated Dec 10, 2024 • 5.98k • 86

unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit

Image-Text-to-Text • 8B • Updated Feb 13, 2025 • 305 • 9

ai-sage/GigaChat-20B-A3B-instruct-v1.5-int8

21B • Updated Jan 30, 2025 • 44 • 2

elenapop/Llama-3.2-11B-Vision-ocr-working_model

Image-Text-to-Text • Updated Feb 18, 2025 • 6 • 1

theGratefulQuad/KINDred

3B • Updated Feb 23, 2025 • 1

unsloth/gpt-oss-120b-unsloth-bnb-4bit

Text Generation • 117B • Updated Aug 8, 2025 • 6.19k • 19

philosop/qwen3-235b-8bit

235B • Updated Oct 23, 2025 • 1

sherif1313/Arabic-handwritten-OCR-4bit-Qwen2.5-VL-3B-v2

Image-to-Text • 4B • Updated Dec 29, 2025 • 388 • 10

EricRollei/HunyuanImage-3.0-Instruct-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 100 • 3

unsloth/gemma-4-31B-it-unsloth-bnb-4bit

Image-Text-to-Text • 31B • Updated Jul 17 • 23.9k • 23

fe-dev-dl/Ornith-1.0-9B-Hardware-Expert-fp16

Text Generation • 9B • Updated Jul 15 • 125 • 4

voxta/Llama-3-8B-LLM2Vec-ARDY-INT8

Feature Extraction • 8B • Updated Jul 30 • 107 • 1

unsloth/Muse-Glimmer-30B-unsloth-bnb-4bit

Image-Text-to-Text • 30B • Updated 23 days ago • 20.1k • 12

prathmeshadsod/MoneyOps-Llama-4-Scout-17B-16E-Instruct

Text Generation • Updated 21 days ago • 15 • 2

greghavens/Qwen3.8-27B-bnb-4bit

Image-Text-to-Text • 27B • Updated 13 days ago • 664 • 2

TomMoeras/contragand-qwen3.5-4b-closed

Text Generation • Updated 9 days ago • 34 • 1

TomMoeras/contragand-qwen3.5-4b-open

Text Generation • Updated 9 days ago • 35 • 1

Risim-hanse/krutrim-2-instruct-4bit

12B • Updated 4 days ago • 14 • 1

ApyHTML19/Gemma-2b-It_EU-AI-Reglementation

3B • Updated 3 days ago • 12 • 1

manitcor/Qwen3.8-27B-Obliterated-E03-bnb-4bit

Text Generation • 27B • Updated 3 days ago • 52 • 1

dddx/mehmehmeh

Text Generation • 7B • Updated Apr 4, 2025 • 14