Q4_0 and Q4_1?

#9
by elpirater312 - opened

Q4_0 is a bit faster for pure CPU inference on my experience, would be nice to have. Thank you.

Sign up or log in to comment