Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+qwen-0.5b-stocks-news-v2-f16.gguf filter=lfs diff=lfs merge=lfs -text
+qwen-0.5b-stocks-news-v2-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+qwen-0.5b-stocks-news-v2-q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,72 @@
+---
+tags:
+  - gguf
+  - qwen2
+  - finance
+  - news-analysis
+  - stock-market
+base_model: Qwen/Qwen2.5-0.5B-Instruct
+license: apache-2.0
+---
+
+# qwen-0.5b-stocks-news-v2 (GGUF)
+
+GGUF quantized versions of [qwen-0.5b-stocks-news-v2](https://huggingface.co/VaibTFU/qwen-0.5b-stocks-news-v2).
+
+## Model Description
+
+Fine-tuned **Qwen2.5-0.5B-Instruct** for financial news analysis. Outputs structured JSON with:
+- `impactTerm`: LONGTERM / SHORTTERM
+- `impactScope`: GLOBAL / INDUSTRY / STOCK
+- `scopeItems`: list of affected stocks/industries
+- `highlights`: key information summary
+- `sentiment`: POSITIVE / NEGATIVE / NEUTRAL
+
+## Available Quantizations
+
+| Quantization | Size | Quality | Use Case |
+|:------------|:-----|:--------|:---------|
+| F16 | ~1 GB | Highest | Reference / GPU inference |
+| Q8_0 | ~530 MB | Very High | Desktop / server inference |
+| Q4_K_M | ~320 MB | Good | Mobile / edge / low-RAM |
+
+## Usage
+
+### With llama.cpp
+
+```bash
+./llama-cli -m qwen-0.5b-stocks-news-v2-q4_k_m.gguf \
+  -p '<|im_start|>system
+You are a financial news AI. Analyze the given news article and output its scope, impact, highlights, and sentiment in JSON format. /no_think<|im_end|>
+<|im_start|>user
+RBI holds repo rate at 6.5% in MPC meeting<|im_end|>
+<|im_start|>assistant
+' \
+  -n 256 --temp 0.7
+```
+
+### With Ollama
+
+Create a `Modelfile`:
+```
+FROM ./qwen-0.5b-stocks-news-v2-q4_k_m.gguf
+
+TEMPLATE """<|im_start|>system
+{{ .System }}<|im_end|>
+<|im_start|>user
+{{ .Prompt }}<|im_end|>
+<|im_start|>assistant
+"""
+
+SYSTEM "You are a financial news AI. Analyze the given news article and output its scope, impact, highlights, and sentiment in JSON format. /no_think"
+
+PARAMETER temperature 0.7
+PARAMETER top_p 0.8
+PARAMETER stop <|im_end|>
+```
+
+Then:
+```bash
+ollama create qwen-0.5b-stocks-news-v2 -f Modelfile
+ollama run qwen-0.5b-stocks-news-v2 "Infosys Q3 profit rises 11%"
+```

qwen-0.5b-stocks-news-v2-f16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8f503393e7b55ebde733d13c3a2790cb0002db5b8081e2edc95ed37c57de30ac
+size 994156320

qwen-0.5b-stocks-news-v2-q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c12b98dccfc8c4ef210fe02e6b52cc10a64ebab1598007aaa4f8c2c8b69240fc
+size 397807392

qwen-0.5b-stocks-news-v2-q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5cee4c0179989239a937561d3c6f2b5b145db782fa1d619b3b9185a640ac48f3
+size 531067680