Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12,578

Base only

Active filters: dpo

syntropy-ai/Soren-1-Small

Text Generation • 2B • Updated 10 days ago • 1.85k • 31

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated 27 days ago • 630 • • 32

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated 29 days ago • 800 • 60

XiangJinYu/Qwen3.5-9B-Humanize-DPO-Round2

Text Generation • Updated 27 days ago • 105 • 4

IHP-Lab/Qwen2-Audio_PCLM_DPO

Audio-Text-to-Text • 8B • Updated 7 days ago • 18 • 2

sapienzanlp/Minerva-7B-instruct-v1.0

Text Generation • Updated Dec 5, 2024 • 2.65k • 23

codelion/Qwen3-0.6B-PTS-DPO

Text Generation • 0.6B • Updated May 12, 2025 • 34 • 2

openmed-community/AFM-4.5B-OpenMed-GGUF

Text Generation • 5B • Updated Oct 2, 2025 • 61 • 9

RISys-Lab/RedSage-Qwen3-8B-DPO

Text Generation • 8B • Updated Feb 9 • 912 • • 9

aquiffoo/neo-3-1B-A90M-Instruct

Text Generation • Updated Apr 17 • 4

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Apr 9 • 186

mrshu/qwen35-0.8b-dpo-think

Text Generation • 0.8B • Updated Mar 13 • 8 • 1

qualcomm-ai-hub-community/CyberSpark2-3b-cabin-chat

Image-Text-to-Text • 4B • Updated 7 days ago • 35 • 2

tensorfiend/DotLM-165M

Text Generation • 0.2B • Updated Apr 4 • 2 • 1

TinmanLabSL/gemma3-4b-companion

Text Generation • Updated Apr 22 • 3

Tinman-Lab/Tinman-gemma4-companion-dpo

Updated Apr 22 • 1

XiaoXu123123/academic-humanize-qwen25-7b-dpo-v2-lora

Text Generation • Updated 30 days ago • 48 • 2

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-GGUF

Image-Text-to-Text • 125B • Updated 1 day ago • 1.82k • 2

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated

Image-Text-to-Text • 123B • Updated 1 day ago • 1.01k • 8

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-MTPLX-4bit

Image-Text-to-Text • 20B • Updated 1 day ago • 1.82k • 2

IHP-Lab/AF3_PCLM_DPO

Audio-Text-to-Text • Updated 7 days ago • 16 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 5 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 12 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 3

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 21 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 12 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 13 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 72 • 124