Qwen1.5-MoE-A2.7B EAGLE3 Draft Model

EAGLE3 speculative decoding draft model for Qwen1.5-MoE-A2.7B.

Model Details

  • Target Model: Qwen/Qwen1.5-MoE-A2.7B
  • Training Data: ShareGPT
  • Epochs: 10
  • Framework: SpecForge
  • Author: Yuseon Choi

Usage

This model is designed to be used with EAGLE3 speculative decoding.

Downloads last month
12
Safetensors
Model size
0.1B params
Tensor type
I64
·
BF16
·
BOOL
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yschoi31/Qwen1.5-MoE-A2.7B-Eagle3

Finetuned
(37)
this model

Dataset used to train yschoi31/Qwen1.5-MoE-A2.7B-Eagle3