ondevicellm/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 56 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
10,635
Active filters: dpo, trl
mlabonne/TwinLlama-3.1-8B-DPO
Text Generation • 8B • Updated • 70 • 26
mradermacher/Qwen2.5-14B-sft-all-pool-GGUF
15B • Updated • 144 • 2
trentmkelly/gpt-4o-distil-Llama-3.1-8B-Instruct
Text Generation • Updated • 54 • 5
arunsingh80475/qwen2.5-14b-humanizer-v4-lora
Text Generation • Updated • 16 • 1
lewtun/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 15
alignment-handbook/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 125 • 3
alignment-handbook/zephyr-7b-dpo-qlora
Updated • 59 • 9
amirali1985/gpt-neo-125m_hh_reward
Text Generation • 0.1B • Updated • 19
lewtun/zephyr-7b-dpo-qlora
Updated • 35
sambar/zephyr-7b-ipo-lora
Text Generation • Updated • 9
nlee282/moai-dpo-1.0
Updated • 10
nikkoyabut/merged_model_dpo
Updated • 1
sambar/zephyr-7b-ipo-lora-5ep
Text Generation • Updated • 4
alexredna/TinyLlama-1.1B-Chat-v1.0-reasoning-v2-dpo
Text Generation • 1B • Updated • 19 • 2
AlbelTec/mistral-dpo-old
Updated • 6
Yaxin1992/mixtral-dpo-1000
Updated • 10
adhi29/openhermes-mistral-dpo-gptq
Updated
ybelkada/test-tags-model
Text Generation • 1.03M • Updated • 196
ybelkada/test-tags-model-2
Text Generation • 1.03M • Updated • 190
justinj92/dpoplatypus-phi2
Text Generation • 3B • Updated
Belred/mistral-dpo
Updated • 2
lewtun/zephyr-7b-dpo-qlora-8e0975a
Updated • 13
mecoaoge2/results
Updated • 6
mecoaoge2/fununun
Updated • 18
akashkumarbtc/openhermes-mistral-dpo-gptq
Updated
darshan8950/openhermes-mistral-dpo-gptq
Updated
sonu2023/mistral-dpo
Updated
jdang/openhermes-mistral-dpo-gptq
Updated
winglian/zephyr-deita-dpo
Updated • 2