Can you upload 8bpw quant too?
#1
by cpral - opened
Hi. I'd want to play with manually tuned quants and I can't find the 8bpw quant referenced in the override file. Can you please share it so that I don't have to recompute it? If you have HF storage issue I can host it in my account, I have 5tb left.
I have added it in the branch 8bpw_H8: https://huggingface.co/mratsim/Qwen3.5-397B-A17B-EXL3/tree/8bpw_H8
cpral changed discussion status to closed