11 ms·
What a train wreck, there are thousand more apps in store that do exactly this because its the easiest way to use openAI without having to host your own backend
by brahyam 1y ago
What a train wreck, there are thousand more apps in store that do exactly this because its the easiest way to use openAI without having to host your own backend/proxy.
I have spend quite some time protecting my apps from this scenario and found a couple of open source projects that do a good job as proxys (no affiliation I just used them in the past):
- https://github.com/BerriAI/litellm https://github.com/BerriAI/litellm
- https://github.com/KenyonY/openai-forward/tree/main https://github.com/KenyonY/openai-forward/tree/main
but they still lack other abuse protection mechanism like rate limitting, device attestation etc. so I started building my own open source SDK
- https://github.com/brahyam/Gateway https://github.com/brahyam/Gateway