Models

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 168k • 129

TechxGenus/Mistral-7B-v0.3-AWQ

Text Generation • 7B • Updated May 23, 2024 • 65 • 1

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1.42k • 6

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 181k • 82

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • 8B • Updated Feb 15 • 31.7k • 106

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 151k • 31

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • 8B • Updated Jun 16 • 4.16k • 86

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • 1B • Updated Sep 4, 2024 • 151k • 16

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • 8B • Updated Oct 9, 2024 • 156k • 34

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • 73B • Updated Oct 9, 2024 • 307k • 73

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Feb 6 • 11.2k • 13

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • 34B • Updated Apr 28 • 10.2k • 14

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Jun 2 • 44.1k • 31

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 157k • 17

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Dec 7, 2024 • 190k • 28

nisten/qwen2.5-coder-7b-abliterated-128k-AWQ

Text Generation • 8B • Updated Jan 7 • 62 • 1

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • 18B • Updated Feb 14 • 4.66k • 29

mlx-community/DeepSeek-R1-4bit

126B • Updated Feb 26 • 1.95k • 37

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • 12B • Updated Feb 10 • 64 • 2

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6 • 94k • 96

krishnateja95/DeepseekVL2-4bit

3B • Updated Feb 20 • 5 • 1

Qwen/QwQ-32B-AWQ

Text Generation • 33B • Updated Mar 11 • 5.42k • 133

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • 6B • Updated Apr 6 • 122k • 37

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • 4B • Updated May 13 • 72.5k • 16

unsloth/Qwen3-14B-unsloth-bnb-4bit

Text Generation • 15B • Updated May 13 • 67.3k • 12

unsloth/Qwen3-0.6B-unsloth-bnb-4bit

Text Generation • 0.6B • Updated Jun 23 • 46.2k • 20

unsloth/Qwen3-1.7B-unsloth-bnb-4bit

Text Generation • 2B • Updated May 13 • 36.2k • 11

lmstudio-community/Qwen3-8B-MLX-4bit

Text Generation • 1B • Updated Apr 28 • 63.1k • 1

mlx-community/Qwen3-0.6B-4bit

Text Generation • Updated Apr 28 • 13k • 8

MaziyarPanahi/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 28 • 220k • 7