11 ms·
Maybe a really lightweight fast LLM could moderate messages in realtime. Not sure how pricey that would get though.
by lifeformed 3mo ago
Maybe a really lightweight fast LLM could moderate messages in realtime. Not sure how pricey that would get though.
- michaelmrose 3mo agoExtremely if not behind substantially cheaper anti spam measures. Further it may still make sense to use human reports to gate some automation even if it slows response.
- Jolter 3mo agoNo matter how cheap per request, someone will figure out a way to DoS that endpoint, and it will be extremely pricy unless you have effective rate limiting.
- Kiro 3mo agoThe OpenAI moderation endpoint is free and it doesn't count toward the usage limit.