Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,11 @@ Exllamav2 quantized versions of [mlabonne/gemma-3-27b-it-abliterated](https://hu
|
|
| 16 |
## Hardware Requirements
|
| 17 |
4.0 bpw version fits on a 24GB GPU with 8192 context window
|
| 18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
### Direct Download
|
| 20 |
```bash
|
| 21 |
huggingface-cli download Kooten/gemma-3-27b-it-abliterated-exl2 --revision 4.0bpw --local-dir gemma-3-27b-it-abliterated-4.0bpw --local-dir-use-symlinks False
|
|
|
|
| 16 |
## Hardware Requirements
|
| 17 |
4.0 bpw version fits on a 24GB GPU with 8192 context window
|
| 18 |
|
| 19 |
+
## Vision
|
| 20 |
+
Vision works with [ExllamaV2 0.2.9](https://github.com/turboderp-org/exllamav2/releases/tag/v0.2.9)
|
| 21 |
+
|
| 22 |
+
Confirmed with exllamav2s [examples/multimodal.py](https://github.com/turboderp-org/exllamav2/blob/master/examples/multimodal.py)
|
| 23 |
+
|
| 24 |
### Direct Download
|
| 25 |
```bash
|
| 26 |
huggingface-cli download Kooten/gemma-3-27b-it-abliterated-exl2 --revision 4.0bpw --local-dir gemma-3-27b-it-abliterated-4.0bpw --local-dir-use-symlinks False
|