Update README.md
Browse files
README.md
CHANGED
|
@@ -24,6 +24,12 @@ This project is for research purposes only. Third-party datasets may be subject
|
|
| 24 |
## How to Get Started with the Model
|
| 25 |
|
| 26 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
```
|
| 28 |
from transformers import AutoTokenizer
|
| 29 |
tokenizer = AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B')
|
|
|
|
| 24 |
## How to Get Started with the Model
|
| 25 |
|
| 26 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
| 27 |
+
1. ## Install llama-cpp-python:
|
| 28 |
+
|
| 29 |
+
! CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python
|
| 30 |
+
|
| 31 |
+
2. ## Run the model
|
| 32 |
+
|
| 33 |
```
|
| 34 |
from transformers import AutoTokenizer
|
| 35 |
tokenizer = AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B')
|