Update README.md
Browse files
README.md
CHANGED
|
@@ -15,11 +15,10 @@ This model is an int4 model with group_size 128 and symmetric quantization of [m
|
|
| 15 |
### Requirements
|
| 16 |
Please use Transformers version >= 4.52
|
| 17 |
|
| 18 |
-
AutoRound version >
|
| 19 |
|
| 20 |
### INT4 Inference
|
| 21 |
```python
|
| 22 |
-
from auto_round import AutoRoundConfig ## must import for auto-round format
|
| 23 |
import requests
|
| 24 |
import torch
|
| 25 |
from PIL import Image
|
|
|
|
| 15 |
### Requirements
|
| 16 |
Please use Transformers version >= 4.52
|
| 17 |
|
| 18 |
+
AutoRound version > 0.5.1
|
| 19 |
|
| 20 |
### INT4 Inference
|
| 21 |
```python
|
|
|
|
| 22 |
import requests
|
| 23 |
import torch
|
| 24 |
from PIL import Image
|