unsloth

/

Qwen3.6-27B-GGUF

like 540

Follow

Unsloth AI 21k

Thanks!

I don't have a GPU, but will try Q6_K_XL. Thanks for creating the GGUF-Files. 2-3 years ago i used 70B models with 1 token/second. Now I'm spoiled by MoE models.

this thing made an incredible solar system even at 2 bit xl and

a sort of broken Jenga tower that has an AI that makes the moves to dismantle the tower all done one shot incredible

a sort of broken Jenga tower that has an AI that makes the moves to dismantle the tower all done one shot incredible

u might wanna search for massgravel for your windows issues

Can it run in vps with
UBUNTU 24.04 LTS
CPU16 vCPU Cores
RAM64 GB RAM
Storage 600 GB NVMe
16GB GB SWAP FILE
, ?

use the moe if you don't hate yourself it's going to be so slow with no gpu but if you must it's free to download and try it