Hello,Could you please quantilze the AWQ model?AWQ quantization or similar is best for running in vLLM
· Sign up or log in to comment