Prompt template for GPT4All:
<|endoftext|>Instruct: %1<|endoftext|>
<|endoftext|>Output: %2<|endoftext|>
record low training loss on netcat420/MFANN for the 2.78b model!
(0.538)
previous record: (0.632)
- Downloads last month
- 12
Prompt template for GPT4All:
<|endoftext|>Instruct: %1<|endoftext|>
<|endoftext|>Output: %2<|endoftext|>
record low training loss on netcat420/MFANN for the 2.78b model!
(0.538)
previous record: (0.632)
Install from pip and serve model
# Install vLLM from pip: pip install vllm# Start the vLLM server: vllm serve "netcat420/MFANN3bv0.17"# Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "netcat420/MFANN3bv0.17", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'