Safetensors
mllama
4-bit precision
auto-round
cicdatopea commited on
Commit
0a32157
·
verified ·
1 Parent(s): 9840b33

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -15,11 +15,10 @@ This model is an int4 model with group_size 128 and symmetric quantization of [m
15
  ### Requirements
16
  Please use Transformers version >= 4.52
17
 
18
- AutoRound version >= 0.4.1
19
 
20
  ### INT4 Inference
21
  ```python
22
- from auto_round import AutoRoundConfig ## must import for auto-round format
23
  import requests
24
  import torch
25
  from PIL import Image
 
15
  ### Requirements
16
  Please use Transformers version >= 4.52
17
 
18
+ AutoRound version > 0.5.1
19
 
20
  ### INT4 Inference
21
  ```python
 
22
  import requests
23
  import torch
24
  from PIL import Image