miike-ai
/

DeepSeek-R1-Distill-Llama-70B-FP4

8-bit precision

compressed-tensors

Model card Files Files and versions

DeepSeek-R1-Distill-Llama-70B-FP4 / recipe.yaml

miike-ai's picture

Add files using upload-large-folder tool

c63afa7 verified 11 months ago

133 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: [lm_head]
	scheme: NVFP4A16