Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,220

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 8 days ago • 3.97M • 2.39k

FermionResearch/Phonon-2

Automatic Speech Recognition • Updated 2 days ago • 2.36k • 172

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 3 days ago • 2.03M • 1.11k

Cactus-Compute/needle3

Text Generation • Updated 2 days ago • 104k • 282

Cactus-Compute/whistle

Automatic Speech Recognition • Updated 2 days ago • 70 • 35

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 11 days ago • 70.6k • 420

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 5 days ago • 1.06M • 1.71k

FINAL-Bench/POCKET-Darwin-180B-GGUF

Text Generation • 177B • Updated about 3 hours ago • 348 • 52

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 22 days ago • 265k • 350

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 29.8k • 980

FINAL-Bench/POCKET-Zimage-CPU

Text-to-Image • 6B • Updated 9 days ago • 450 • 49

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 424k • 885

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 16 days ago • 90.5k • 157

wenzhouwu/YoungAi-DeepSeek-V4.1-Flash

Text Generation • Updated 4 days ago • 7

desert-ant-labs/clear

Audio-to-Audio • Updated about 12 hours ago • 1.81k • 31

desert-ant-labs/tongue

Text Classification • Updated about 12 hours ago • 31 • 12

chaoliangUNSW/Jev-Style-0.8B-Decision-v3-GGUF

Text Classification • 0.8B • Updated 8 days ago • 3.2k • 14

chaoliangUNSW/Jev-Style-2B-Decision-v3-GGUF

Text Classification • 2B • Updated 7 days ago • 1.27k • 6

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 117k • 790

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Aug 31 • 626k • • 1.4k

ewin-reg/MiniCPM5-2B-EXL3-Quantized

Text Generation • 0.9B • Updated 18 days ago • 47 • 6

jsbaicenter/Aztec-Coder-4B

Text Generation • 4B • Updated 4 days ago • 2.53k • 8

litert-community/Fun-ASR-Nano-2512

Automatic Speech Recognition • Updated 7 days ago • 46 • 5

Lythri/Lythri-4B-A2B

Text Generation • 5B • Updated about 3 hours ago • 868 • 9

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 372k • 165

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.08M • 260

samuel-vitorino/sopro-v2-turbo

Text-to-Speech • 0.1B • Updated about 12 hours ago • 27.7k • 36

oddadmix/Kokoro-7M-Distill

Text-to-Speech • Updated 17 days ago • 732 • 34

lokutor-ai/oido-ctc-small-int8

Automatic Speech Recognition • Updated 1 day ago • 4

qvac/VisionPsy-Nano-460M-Flash-GGUFs

Image-Text-to-Text • 0.4B • Updated Jul 29 • 6.82k • 13