Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,12 @@ tags:
|
|
| 9 |
---
|
| 10 |
# ANEMLL
|
| 11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
**ANEMLL** (pronounced like "animal") is an open-source project focused on accelerating the porting of Large Language Models (LLMs) to tensor processors, starting with the Apple Neural Engine (ANE).
|
| 13 |
|
| 14 |
The goal is to provide a fully open-source pipeline from model conversion to inference for common LLM architectures running on ANE.
|
|
|
|
| 9 |
---
|
| 10 |
# ANEMLL
|
| 11 |
|
| 12 |
+
This model was converted with following params:
|
| 13 |
+
|
| 14 |
+
Context length: 2048
|
| 15 |
+
|
| 16 |
+
Batch size: 128
|
| 17 |
+
|
| 18 |
**ANEMLL** (pronounced like "animal") is an open-source project focused on accelerating the porting of Large Language Models (LLMs) to tensor processors, starting with the Apple Neural Engine (ANE).
|
| 19 |
|
| 20 |
The goal is to provide a fully open-source pipeline from model conversion to inference for common LLM architectures running on ANE.
|