Disty0
/

FLUX.2-klein-4B-SDNQ-4bit-dynamic

Flux2KleinPipeline

4-bit precision

Model card Files Files and versions

Disty0 commited on Jan 16

Commit

4542b6f

·

verified ·

1 Parent(s): 790ea56

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ tags:
 - flux
 - 4-bit
 ---
-Dynamic 4 bit quantization of [black-forest-labs/FLUX.2-klein-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-9B) using [SDNQ](https://github.com/Disty0/sdnq).
 This model uses per layer fine grained quantization.
 What dtype to use for a layer is selected dynamically by trial and error until the std normalized mse loss is lower than the selected threshold.

 - flux
 - 4-bit
 ---
+Dynamic 4 bit quantization of [black-forest-labs/FLUX.2-klein-4B](https://huggingface.co/black-forest-labs/FLUX.2-klein-4B) using [SDNQ](https://github.com/Disty0/sdnq).
 This model uses per layer fine grained quantization.
 What dtype to use for a layer is selected dynamically by trial and error until the std normalized mse loss is lower than the selected threshold.