Update README.md
Browse files
README.md
CHANGED
|
@@ -75,18 +75,19 @@ Built using efficient fine-tuning with Unsloth + LoRA, this model focuses on imp
|
|
| 75 |
|
| 76 |
---
|
| 77 |
|
| 78 |
-
## 🧪 Evaluation
|
| 79 |
|
| 80 |
-
|
| 81 |
|
| 82 |
-
|
| 83 |
-
| :--- | :--- |
|
| 84 |
-
| **Fluency** | 8.7 / 10 |
|
| 85 |
-
| **Human-likeness** | 8.5 / 10 |
|
| 86 |
-
| **Meaning Preservation** | 9.2 / 10 |
|
| 87 |
|
| 88 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 89 |
|
|
|
|
| 90 |
---
|
| 91 |
|
| 92 |
## 💻 Usage
|
|
@@ -106,15 +107,4 @@ outputs = model.generate(**inputs, max_new_tokens=120)
|
|
| 106 |
|
| 107 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 108 |
|
| 109 |
-
## Evaluation Results (Automated)
|
| 110 |
|
| 111 |
-
The model was evaluated using a professional suite at temperature 0.7.
|
| 112 |
-
|
| 113 |
-
| Metric | Value | Interpretation |
|
| 114 |
-
| :--- | :--- | :--- |
|
| 115 |
-
| **BERTScore F1** | 0.8424 | Semantic Similarity to Prompts |
|
| 116 |
-
| **ROUGE-L** | 0.0908 | Low overlap indicates original generation |
|
| 117 |
-
| **Perplexity** | 1.5242 | Confidence/Coherence (Lower is better) |
|
| 118 |
-
| **Text Overlap** | 0.0528 | Lexical similarity to input |
|
| 119 |
-
|
| 120 |
-
*Results generated and uploaded via Colab automated pipeline.*
|
|
|
|
| 75 |
|
| 76 |
---
|
| 77 |
|
|
|
|
| 78 |
|
| 79 |
+
## Evaluation Results (Automated)
|
| 80 |
|
| 81 |
+
The model was evaluated using a professional suite at temperature 0.7.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
|
| 83 |
+
| Metric | Value | Interpretation |
|
| 84 |
+
| :--- | :--- | :--- |
|
| 85 |
+
| **BERTScore F1** | 0.8424 | Semantic Similarity to Prompts |
|
| 86 |
+
| **ROUGE-L** | 0.0908 | Low overlap indicates original generation |
|
| 87 |
+
| **Perplexity** | 1.5242 | Confidence/Coherence (Lower is better) |
|
| 88 |
+
| **Text Overlap** | 0.0528 | Lexical similarity to input |
|
| 89 |
|
| 90 |
+
*Results generated and uploaded via Colab automated pipeline.*
|
| 91 |
---
|
| 92 |
|
| 93 |
## 💻 Usage
|
|
|
|
| 107 |
|
| 108 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 109 |
|
|
|
|
| 110 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|