Asap7772/Qwen3-4B-second-stage-DPO-lr-1e-6-beta-0.1-loss-sigmoid-rpo-1.0-ckpt-135
196k • Updated • 1
Edit Models filters
Active filters: Asap7772/qwen3-4b-impabs-warmstart-sft-1e-5-1epoch-0828
Asap7772/Qwen3-4B-second-stage-DPO-lr-1e-6-beta-0.01-loss-sigmoid-rpo-1.0-ckpt-135
196k • Updated • 1
Asap7772/Qwen3-4B-second-stage-DPO-lr-1e-6-beta-0.05-loss-sigmoid-rpo-1.0-ckpt-135
196k • Updated • 1
Asap7772/Qwen3-4B-second-stage-DPO-lr-1e-7-beta-0.1-loss-sigmoid-rpo-1.0-ckpt-135
196k • Updated • 4
Asap7772/Qwen3-4B-second-stage-DPO-lr-1e-7-beta-0.01-loss-sigmoid-rpo-1.0-ckpt-135
196k • Updated • 2
Asap7772/Qwen3-4B-second-stage-DPO-lr-1e-7-beta-0.05-loss-sigmoid-rpo-1.0-ckpt-135
196k • Updated • 1