shrikanthzededa commited on
Commit
0d405ce
·
verified ·
1 Parent(s): 8806834

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. .gitattributes +1 -0
  2. Cosmos-Reason2-8B.Q8_0.gguf +3 -0
  3. README.md +36 -0
  4. config.json +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Cosmos-Reason2-8B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Cosmos-Reason2-8B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cd7dc26cb43a9e0a549372647c50923e72c2c95c8c00318d69d1c9765e9e868
3
+ size 8709520128
README.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - nvidia/Cosmos-Reason2-8B
7
+ pipeline_tag: image-text-to-text
8
+ library_name: transformers
9
+ tags:
10
+ - text-generation-inference
11
+ - llama.cpp
12
+ ---
13
+
14
+ # **Cosmos-Reason2-8B-GGUF**
15
+
16
+ > NVIDIA Cosmos-Reason2-8B is an 8.767B-parameter open vision-language model post-trained from Qwen3-VL-8B-Instruct under the permissive NVIDIA Open Model License (commercially usable with derivative rights), designed for physical AI, robotics, and embodied reasoning with enhanced spatio-temporal understanding, physics-based common sense, object detection (2D/3D localization, bounding boxes), and 256K token long-context support for video/image inputs at FPS=4. It excels in use cases like video analytics agents (root-cause analysis via NVIDIA VSS Blueprint), data curation/annotation (Cosmos Curator for sensor data), and robot planning (Isaac GR00T-Dreams for synthetic trajectories), generating chain-of-thought responses in <think>/<answer> format for deliberate decision-making in unfamiliar environments across datasets like EgoExo4D, PerceptionTest, IntPhys, and CLEVRER. Optimized for NVIDIA Blackwell/Hopper GPUs (32GB+ VRAM, BF16 on Linux/H100/A100) with Transformers inference (max_tokens=4096), it handles mp4 videos/jpg images for text outputs in robotics, AVs, and industrial ops while noting limitations in complex dynamics like fast motion or occlusions.
17
+
18
+ ## Cosmos-Reason2-8B [GGUF]
19
+
20
+ | File Name | Quant Type | File Size | File Link |
21
+ | - | - | - | - |
22
+ | Cosmos-Reason2-8B.BF16.gguf | BF16 | 16.4 GB | [Download](https://huggingface.co/prithivMLmods/Cosmos-Reason2-8B-GGUF/blob/main/Cosmos-Reason2-8B.BF16.gguf) |
23
+ | Cosmos-Reason2-8B.F16.gguf | F16 | 16.4 GB | [Download](https://huggingface.co/prithivMLmods/Cosmos-Reason2-8B-GGUF/blob/main/Cosmos-Reason2-8B.F16.gguf) |
24
+ | Cosmos-Reason2-8B.Q8_0.gguf | Q8_0 | 8.71 GB | [Download](https://huggingface.co/prithivMLmods/Cosmos-Reason2-8B-GGUF/blob/main/Cosmos-Reason2-8B.Q8_0.gguf) |
25
+ | Cosmos-Reason2-8B.mmproj-bf16.gguf | mmproj-bf16 | 1.16 GB | [Download](https://huggingface.co/prithivMLmods/Cosmos-Reason2-8B-GGUF/blob/main/Cosmos-Reason2-8B.mmproj-bf16.gguf) |
26
+ | Cosmos-Reason2-8B.mmproj-f16.gguf | mmproj-f16 | 1.16 GB | [Download](https://huggingface.co/prithivMLmods/Cosmos-Reason2-8B-GGUF/blob/main/Cosmos-Reason2-8B.mmproj-f16.gguf) |
27
+ | Cosmos-Reason2-8B.mmproj-q8_0.gguf | mmproj-q8_0 | 752 MB | [Download](https://huggingface.co/prithivMLmods/Cosmos-Reason2-8B-GGUF/blob/main/Cosmos-Reason2-8B.mmproj-q8_0.gguf) |
28
+
29
+ ## Quants Usage
30
+
31
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
32
+
33
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
34
+ types (lower is better):
35
+
36
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "model_type": "qwen3_vl"
3
+ }