anamikac2708 commited on
Commit
c71e7ad
·
verified ·
1 Parent(s): e822fb8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -24,6 +24,12 @@ This project is for research purposes only. Third-party datasets may be subject
24
  ## How to Get Started with the Model
25
 
26
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
 
 
 
 
 
 
27
  ```
28
  from transformers import AutoTokenizer
29
  tokenizer = AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B')
 
24
  ## How to Get Started with the Model
25
 
26
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
27
+ 1. ## Install llama-cpp-python:
28
+
29
+ ! CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python
30
+
31
+ 2. ## Run the model
32
+
33
  ```
34
  from transformers import AutoTokenizer
35
  tokenizer = AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B')