koutch/qwen_falcon_6.json_train_dpo_v1_2.json

Uploaded finetuned model

• Developed by: koutch
• License: apache-2.0
• Finetuned from model : unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.