Duplicated from maxbittker/nemotron3-nano-30b-a3b-spiral-step130
How to use GoodStartLabs/nemotron3-nano-30b-a3b-spiral-step130 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16") model = PeftModel.from_pretrained(base_model, "GoodStartLabs/nemotron3-nano-30b-a3b-spiral-step130")
