itlwas/Dolphin3.0-Qwen2.5-0.5B-Q4_K_M-GGUF
0.5B • Updated
• 45
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Recent Activity
liked
a model about 1 month ago
nvidia/parakeet-tdt-0.6b-v3 liked
a model 2 months ago
zai-org/GLM-4.7 liked
a model 3 months ago
ServiceNow-AI/Apriel-1.6-15b-Thinker Organizations
itlwas/Dolphin3.0-Llama3.2-3B-Q4_K_M-GGUF
3B • Updated
• 327
itlwas/Dolphin3.0-Llama3.2-1B-Q4_K_M-GGUF
1B • Updated
• 81
itlwas/Qwen2.5-32B-Instruct-Q4_K_M-GGUF
Text Generation • 33B • Updated
• 10
itlwas/Qwen2.5-32B-Q4_K_M-GGUF
Text Generation • 33B • Updated
• 10
itlwas/Qwen2.5-14B-Instruct-Q4_K_M-GGUF
Text Generation • 15B • Updated
• 15
itlwas/Qwen2.5-14B-Q4_K_M-GGUF
Text Generation • 15B • Updated
• 6
itlwas/Qwen2.5-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 5
itlwas/Qwen2.5-7B-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 21
itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated
• 29
itlwas/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated
• 8
itlwas/Qwen2.5-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated
• 13
itlwas/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated
• 31
itlwas/Qwen2.5-0.5B-Q4_K_M-GGUF
Text Generation • 0.5B • Updated
• 12
itlwas/openchat_v3.2-Q4_K_M-GGUF
13B • Updated
• 12
itlwas/openchat_v3.2_super-Q4_K_M-GGUF
13B • Updated
• 39
itlwas/openchat-3.5-0106-Q4_K_M-GGUF
Text Generation • 7B • Updated
• 12
itlwas/openchat-3.5-1210-Q4_K_M-GGUF
Text Generation • 7B • Updated
• 13
itlwas/Qwen1.5-32B-Chat-Q4_K_M-GGUF
Text Generation • 33B • Updated
• 6
itlwas/Qwen1.5-32B-Q4_K_M-GGUF
Text Generation • 33B • Updated
• 6
itlwas/Qwen1.5-14B-Chat-Q4_K_M-GGUF
Text Generation • 14B • Updated
• 25
itlwas/Qwen1.5-14B-Q4_K_M-GGUF
Text Generation • 14B • Updated
• 6
itlwas/Qwen1.5-7B-Chat-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 111
itlwas/Qwen1.5-7B-Q4_K_M-GGUF
Text Generation • 8B • Updated
• 908
itlwas/Qwen1.5-4B-Chat-Q4_K_M-GGUF
Text Generation • 4B • Updated
• 17
itlwas/Qwen1.5-4B-Q4_K_M-GGUF
Text Generation • 4B • Updated
• 13
itlwas/Qwen1.5-1.8B-Chat-Q4_K_M-GGUF
Text Generation • 2B • Updated
• 72
itlwas/Qwen1.5-1.8B-Q4_K_M-GGUF
Text Generation • 2B • Updated
• 13
itlwas/Qwen1.5-0.5B-Chat-Q4_K_M-GGUF
Text Generation • 0.6B • Updated
• 13
itlwas/Qwen1.5-0.5B-Q4_K_M-GGUF
Text Generation • 0.6B • Updated
• 30