Recommended settings?
#1
by elpirater312 - opened
What are the recommended settings for temperature, top-p, top-k, min-p, repeat penalty and so on?
Give these a try.
Temperature: 0.75–0.85 (pick 0.8)
Top-P: 0.90–0.95 (pick 0.92 if you want it a touch tighter)
Repeat penalty: 1.10
Max tokens 2048–4096
I've been leaving the others alone as I don't have theme exposed in my UI, but i'll post a more detailed run down in the model card asap.