gmarkwa

5 ms·

1. 1.▲
   Ultra Fast LLM's Are Interesting (Mercury 2.5 Preview Release)(openrouter.ai)

   1 points by gmarkwa 15d ago|1 comments
2. 2.▲
   by gmarkwa 15d ago

   I see almost no discussion about the use cases for extremely fast diffusion models like Mercury which can apparently reach 1,000+ tps throughput, at an intelligence level around 32 on the Artificial Analysis Intelligence Index (according to
3. 3.▲
   by gmarkwa 19d ago

   Yeah maybe I'm conflating an "agent with tools" with a chat feature. Just because I'm using an agent with tools doesn't mean I need to chat with it, I could just click a button and have it do things, in the same way
4. 4.▲
   by gmarkwa 19d ago

   Could you give me an example? Like a real example of an LLM based application with no chat? Now that I think of it something like Tavily comes to mind as an example.
5. 5.▲
   Is "An agent with tools" the only valid LLM application?

   5 points by gmarkwa 19d ago|5 comments
6. 6.▲
   by gmarkwa 3mo ago

   I mean they can be deterministic, thinking machines lab made deterministic LLM's: https://thinkingmachines.ai/blog/defeating-nondeterminism-in... . Although obviously I'd rather they stay non-deterministic