Please add Ollama num_gpu. #1

Open

opened

Please add Ollama "num_gpu" as a parameter. It makes some LLMs respond faster.

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests