UD confusion
#20
by inputout - opened
The documentation does not indicate what the difference is between the “UD” variants of the same sized “normal” quants.
e.g. Q4_K_M and UD-Q4_K_M what is the difference and which one has the better real world evals (LiveCodeBench v6, MMLU Pro)?
In your documentation and GGUF Benchmarks there is no explanation of these UD variants.
@inputout The SHA256 values of the weights are identical across these models. The same goes for many other quants like Q4_K_S or Q3_K_M. I think there was simply a mistake during the upload that led to duplicated weights. You can download either one.
Thanks! Comparing SHA256 was smart.