Feature Request: sampling parameters from teuken suggestions. #5
Description
Prerequisites
- I am running the latest code. Mention the version if possible as well.
- I carefully followed the README.md.
- I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
teuken should be started with the same sampling options as described in huggingface.
Motivation
The default sampling options from llama.cpp are not appropiate for teuken.
Possible Implementation
No response