roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 17
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 31
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 40
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 6
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 9
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 8
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 119 • 2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 1
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 1
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 14
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 439
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 33