Q5/6/8
#2
by Arkovski - opened
Hi man,
Are you planning to do other abliterated versions, also GGUF, but with a higher quantz?
Thanks!
Thank you for you interesting in my repository.
Currently, Q4 is my daily driver on 3090 Ti, which fitted my need. As new models come, I absolutely made alliterated version of them. Q5/6/8 will be come shortly in this repo.