runtime error

Exit code: 1. Reason: ransformer2DModel.from_pretrained( AIO_REPO_ID, ...<6 lines>... device_map="cuda", ) File "/usr/local/lib/python3.13/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/usr/local/lib/python3.13/site-packages/diffusers/models/modeling_utils.py", line 1113, in from_pretrained hf_quantizer.validate_environment(torch_dtype=torch_dtype, from_flax=from_flax, device_map=device_map) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/diffusers/quantizers/bitsandbytes/bnb_quantizer.py", line 354, in validate_environment raise RuntimeError("No GPU found. A GPU is needed for quantization.") RuntimeError: No GPU found. A GPU is needed for quantization. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/app/app.py", line 271, in <module> pipe = _load_pipe_with_version(AIO_VERSION, use_8bit=USE_8BIT, use_8bit_text_encoder=USE_8BIT_TEXT_ENCODER) File "/app/app.py", line 215, in _load_pipe_with_version transformer = QwenImageTransformer2DModel.from_pretrained( AIO_REPO_ID, ...<6 lines>... device_map="cuda", ) File "/usr/local/lib/python3.13/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/usr/local/lib/python3.13/site-packages/diffusers/models/modeling_utils.py", line 1113, in from_pretrained hf_quantizer.validate_environment(torch_dtype=torch_dtype, from_flax=from_flax, device_map=device_map) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/diffusers/quantizers/bitsandbytes/bnb_quantizer.py", line 354, in validate_environment raise RuntimeError("No GPU found. A GPU is needed for quantization.") RuntimeError: No GPU found. A GPU is needed for quantization.

Container logs: