Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,796

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 6 days ago • 595k • • 1k

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 7 days ago • 2.03M • 626

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 10 days ago • 35.8k • 174

Cactus-Compute/needle

30.4M • Updated 11 days ago • 1.26k • 304

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 10 days ago • 28.7k • 144

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated May 26 • 505k • 994

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated about 7 hours ago • 5.51k • 33

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 81.1k • 126

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 47.7k • 891

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 46.4k • 759

FINAL-Bench/POCKET-KR-GGUF

Text Generation • 23B • Updated about 7 hours ago • 403 • 24

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated about 7 hours ago • 359 • 23

FINAL-Bench/POCKET-KR-MLX

Text Generation • 15B • Updated about 7 hours ago • 197 • 23

prism-ml/Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated Apr 18 • 20.3k • 229

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 6.22k • 38

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 2.8k • 87

Aatricks/bonsai-image-ternary-4B-FLUX2-klein-GGUF

Text-to-Image • 4B • Updated Jun 3 • 375 • 7

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 25 • 92.7k • 209

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 6.81k • 27

Reza2kn/Shenava-Koochik-v1.0

Automatic Speech Recognition • Updated 28 days ago • 398 • 13

prism-ml/Ternary-Bonsai-1.7B-mlx-2bit

Text Generation • 0.1B • Updated Apr 18 • 1.67k • 17

prism-ml/bonsai-image-binary-4B-mlx-1bit

Text-to-Image • Updated Jun 1 • 289 • 38

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 423 • 3

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 8B • Updated 26 days ago • 2.85k • 5

lowdown-labs/fela-streaming-asr

Automatic Speech Recognition • 64.4M • Updated 18 days ago • 18 • 2

litert-community/MedGemma-1.5-4B-IT

Text Generation • Updated 13 days ago • 441 • 6

mihuai/turkish-stt

Automatic Speech Recognition • Updated 2 days ago • 2

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 26.5k • 80

prism-ml/Ternary-Bonsai-8B-mlx-2bit

Text Generation • 0.6B • Updated Apr 18 • 20.7k • 117

prism-ml/Ternary-Bonsai-4B-mlx-2bit

Text Generation • 0.3B • Updated Apr 18 • 1.11k • 10