BF16 and imatrix file

#3
by pirola - opened

First of all, thanks for these APEX versions. But have you thought about leaving the original imatrix files with the ggufs? So we could play with our own quantizations? and this would go hand-to-hand with the BF16 model as well.

Sign up or log in to comment