OpenAi Provider Research

[sroussey]

Some things to look at:

• Read up on OpenAi API
  
  • See how text streaming is done and compare to how HF transformers.js does it
  • Note on rate limits and how to work with the task queue
  • Look at options like temperature
• Check out how others use multiple providers
  • First research who uses multiple providers in OSS
  • Start with Vercel and their ai library