Inference Providers
Active filters: cpo, trl
NBA55/Experiment_with_trained_model_Final_CPO_for_all_3_issues-epoch-2
Updated
smohammadi/llama2-lora-aligned-cpo
NBA55/Final_Experiment_with_trained_model_Final_CPO_for_all_3_issues-epoch-2
Updated
Text Generation • 0.1B • Updated • 8
ravithejads/test_model_sft
Text Generation • 0.1B • Updated maxmyn/c4ai-takehome-model-simpo
Text Generation • 0.1B • Updated • 6
Text Generation • 0.1B • Updated • 5
Text Generation • 0.1B • Updated • 6
CharlesLi/OpenELM-1_1B-SimPO
Text Generation • 1B • Updated • 6
CharlesLi/OpenELM-1_1B-CPO
Text Generation • 1B • Updated • 8
NBA55/CPO_with_baseline_modalh
Text Generation • 7B • Updated • 8
NBA55/CPO_with_trained_model_for_all_3_issues-epoch-2
Updated
rawsh/mirrorqwen2.5-0.5b-SimPO
Text Generation • 0.5B • Updated • 28
Text Generation • 0.5B • Updated • 24
rawsh/mirrorqwen2.5-0.5b-SimPO-0
Text Generation • 0.5B • Updated • 26
mradermacher/mirrorqwen2.5-0.5b-SimPO-GGUF
0.5B • Updated • 571
mradermacher/mirrorqwen2.5-0.5b-SimPO-0-GGUF
0.5B • Updated • 368
rawsh/mirrorqwen2.5-0.5b-SimPO-1
Text Generation • 0.5B • Updated • 28
rawsh/mirrorqwen2.5-0.5b-SimPO-2
Text Generation • 0.5B • Updated • 30
rawsh/mirrorqwen2.5-0.5b-SimPO-3
Text Generation • 0.5B • Updated • 23
mradermacher/mirrorqwen2.5-0.5b-SimPO-1-GGUF
0.5B • Updated • 72
mradermacher/mirrorqwen2.5-0.5b-SimPO-2-GGUF
0.5B • Updated • 272
mradermacher/mirrorqwen2.5-0.5b-SimPO-3-GGUF
0.5B • Updated • 210
Aratako/Llama-Gemma-2-27b-CPO_SimPO-iter1
Text Generation • 27B • Updated • 30
• 1
Aratako/Llama-Gemma-2-27b-CPO_SimPO-iter2
Text Generation • 27B • Updated • 16
• 1
Aratako/gemma-2-2b-axolotl-simpo-v1.0
Text Generation • Updated • 24
Aratako/gemma-2-2b-axolotl-simpo-v1.0-merged
Text Generation • Updated • 30
• 1
mradermacher/gemma-2-2b-axolotl-simpo-v1.0-merged-GGUF
3B • Updated • 561
mjhamar/Meta-Llama-3.1-8B-Instruct-cpo-beir
Text Generation • 8B • Updated • 3