Instructions to use IndexTeam/Index-anisora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use IndexTeam/Index-anisora with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("IndexTeam/Index-anisora", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
能不能出一个gguf格式量化版,例如nf4?
#3
by manbaout - opened
使用fp8版本的14b模型对于16gvram+32gram设备很不友好,这会出现内存不足的问题,如果出一个低精度的量化(例如q4、nf4一类)将会有助于带来更高的可用性