gemma-3-12b-it BigSmall
Losslessly compressed version of google/gemma-3-12b-it using BigSmall.
Usage
ash pip install bigsmall bigsmall decode wpferrell/gemma-3-12b-it-bigsmall ./gemma-3-12b-it
Compression
Bit-identical reconstruction -- md5-verified on every tensor. No quality loss whatsoever.
Feedback
Did this work for you? Open a discussion or file an issue.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support