Gemma 4 Tool Calling is amazing in Unsloth Studio!

#4
by danielhanchen - opened

Hey guys, feel free to run and train Gemma 4 in Unsloth Studio. The tool-calling is quite amazing!
GitHub: https://github.com/unslothai/unsloth
Guide: https://unsloth.ai/docs/models/gemma-4#unsloth-studio-guide

See examples:

gemma 4 in unsloth studio
danielhanchen pinned discussion

If I have an Apple M3 Ultra, and want to use GGUF instead of MLX in Unsloth Studio, should I pick a F16 or BF16 version?

Unsloth AI org

If I have an Apple M3 Ultra, and want to use GGUF instead of MLX in Unsloth Studio, should I pick a F16 or BF16 version?

You can use GGUF as well in Studio. Use either it shouldn't matter much. BF16 is usually the better option if your device supports it

Thank you! I asked ChatGPT first and it said that BF16 is not good at all for Apple Silicon.

PS. I am looking forward to being able to train using Apple Silicon - I remember seeing a post somewhere saying it was in-progress coming soon.

Unsloth AI org

Thank you! I asked ChatGPT first and it said that BF16 is not good at all for Apple Silicon.

PS. I am looking forward to being able to train using Apple Silicon - I remember seeing a post somewhere saying it was in-progress coming soon.

Yesss it's coming this month!! Stay tuned πŸ™

shimmyshimmer changed discussion title from Run + Train Gemma 4 in Unsloth Studio! to Gemma 4 Tool Calling is amazing in Unsloth Studio!

Sign up or log in to comment