Stemming from OpenAI's APIs being down the last few days (and us being down subsequently), we launched an open source OpenAI + Azure fallback and retry tool: https://github.com/Spryngtime/openai-load-balancer
This open source library helps you mitigate errors & downtime from @OpenAI's APIs by retrying and falling back to Azure (and vice versa).
About 5 minutes to setup - syntatically the exact same as OpenAI's library.
If you need expedited access to Azure, feel free to email me - I can get you connected to our Azure account executive! (Startups with funding ONLY please!)
1 comment
[ 3.9 ms ] story [ 10.7 ms ] threadThis open source library helps you mitigate errors & downtime from @OpenAI's APIs by retrying and falling back to Azure (and vice versa).
About 5 minutes to setup - syntatically the exact same as OpenAI's library.
If you need expedited access to Azure, feel free to email me - I can get you connected to our Azure account executive! (Startups with funding ONLY please!)
Hope this helps some people out there!