[Request] Recommended llama.cpp parameters

#1
by BlueSwordM - opened

Hello. I've just noticed you uploaded your models on Ollama.

However, I mainly use llama.CPP, and I don't know what would be the recommended sampling parameters to run them in llama.CPP

As such, it would be great if you peeps could add recommended sampling parameters in the main posts for all of the models so we can extract as much performance from them as possible.

Thank you and have a good day.

yes please

Sign up or log in to comment