brettdav

7 ms·

1. 1.▲
   by brettdav 13d ago

   What about Cloudflare’s public DNS? https://developers.cloudflare.com/1.1.1.1/setup/#1111-for-fa... 1.1.1.2 1.0.0.2 2606:4700:4700::1112 2606:4700:4700::1002
2. 2.▲
   by brettdav 14d ago

   Yes, that makes sense. Some of my models currently run in ollama while others require their own inference servers. I’m curious about custom inference servers in bifrost and the ability to orchestrate keeping some models warm in memory while
3. 3.▲
   by brettdav 14d ago

   I’ve deployed mcp to prod on numerous internal apps where ai-integration has been first party requirement. Obviously, agents can use an existing api, however maximum capability requires it to be well designed and documented. As many of you
4. 4.▲
   by brettdav 16d ago

   Can you share a bit more about your bifrost and llama swap setup? I’m facing memory constraints and am looking for a managed model solution that will help with hot swapping loaded models and stay-warm concurrency. Ideally with prioritizatio
5. 5.▲
   Hacker sends email blast to Internet Archive Zendesk support ticket submitters

   10 points by brettdav 2y ago|5 comments