Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,230

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 9 days ago • 4.05M • 2.4k

FermionResearch/Phonon-2

Automatic Speech Recognition • Updated 3 days ago • 2.64k • 181

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 3 days ago • 2.06M • 1.13k

Cactus-Compute/whistle

Automatic Speech Recognition • Updated 2 days ago • 542 • 52

Cactus-Compute/needle3

Text Generation • Updated 2 days ago • 108k • 286

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 12 days ago • 71.9k • 422

FINAL-Bench/POCKET-Darwin-180B-GGUF

Text Generation • 177B • Updated about 14 hours ago • 619 • 53

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 5 days ago • 1.11M • 1.71k

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 22 days ago • 277k • 353

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 30.3k • 980

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 422k • 887

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 16 days ago • 93.4k • 157

desert-ant-labs/clear

Audio-to-Audio • Updated about 23 hours ago • 1.81k • 31

desert-ant-labs/tongue

Text Classification • Updated about 23 hours ago • 31 • 12

chaoliangUNSW/Jev-Style-0.8B-Decision-v3-GGUF

Text Classification • 0.8B • Updated 8 days ago • 3.39k • 14

wenzhouwu/YoungAi-DeepSeek-V4.1-Flash

Text Generation • Updated 4 days ago • 7

Lythri/Lythri-4B-A2B

Text Generation • 5B • Updated about 2 hours ago • 1.48k • 10

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 118k • 790

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Aug 31 • 618k • • 1.4k

ewin-reg/MiniCPM5-2B-EXL3-Quantized

Text Generation • 0.9B • Updated 19 days ago • 54 • 7

chaoliangUNSW/Jev-Style-2B-Decision-v3-GGUF

Text Classification • 2B • Updated 7 days ago • 1.37k • 6

litert-community/Fun-ASR-Nano-2512

Automatic Speech Recognition • Updated 7 days ago • 56 • 5

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 370k • 165

samuel-vitorino/sopro-v2-turbo

Text-to-Speech • 0.1B • Updated about 23 hours ago • 28.6k • 36

lokutor-ai/oido-ctc-small-int8

Automatic Speech Recognition • Updated 1 day ago • 4

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.08M • 260

qvac/VisionPsy-Nano-460M-Flash-GGUFs

Image-Text-to-Text • 0.4B • Updated Jul 29 • 6.74k • 13

litert-community/Bonsai-Image-ternary-4B

Text-to-Image • Updated 2 days ago • 3.62k • 10

desert-ant-labs/align

Automatic Speech Recognition • Updated about 23 hours ago • 831 • 11

openbmb/MiniCPM5-2B-MLX

Text Generation • 3B • Updated 22 days ago • 352k • 54