Support other API providers in the "AI Toolbar" #2695
Description
What problem does this address?
The AI toolbar is unchangeably bound to OpenAI. From a data protection perspective in particular, there are good and better alternatives. Models from Antropic or Mistral AI are also very well suited for generating text. Some users maybe like to use self-hosted models with Ollama, BentoML etc. aswell.
What is your proposed solution?
Add an optional parameter to the “AI Toolbar” settings that allows you to set BASE_URL of the API to use. Default value could point to https://api.openai.com/v1/ which is the OpenAI platform.
Other AI platform API like Mistral AI's or Anthropic's are "OpenAI compatible", which means client integration only needs to user another BASE_URL of the API. The client code does not need to be touched.
Examples for other OpenAI compatible API base urls
Anthropic: https://api.anthropic.com/v1/
Mistral AI: https://api.mistral.ai/v1/
This approach would also allow the use of self-hosted AI Models in the "AI Toolbar", because runtimes like Ollama or OpenLLM are also compatible with the OpenAI API scheme.
Will this feature require documentation? (Optional)
Yes, it requires documentation.