lee5j
/

Athene-V2-Chat-gptq4

4-bit precision

Model card Files Files and versions

just use for

vllm serve lee5j/Athene-V2-Chat-gptq4 --gpu-memory-utilization 1

Downloads last month: 3

Safetensors

Model size

73B params

Tensor type

I32

·

BF16

·

F16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lee5j/Athene-V2-Chat-gptq4

Base model

Qwen/Qwen2.5-72B

Finetuned

Qwen/Qwen2.5-72B-Instruct

Finetuned

Nexusflow/Athene-V2-Chat

Quantized

(25)

this model