9 ms·

> Muse Glimmer is a 30-billion-parameter model optimized for always-on local agent workflows. It’s small enough to run on a Mac or PC with a single consumer GPU

> Muse Glimmer is a 30-billion-parameter model optimized for always-on local agent workflows. It’s small enough to run on a Mac or PC with a single consumer GPU, enabling use cases that range from local agents and function calling, to local coding, and LLM-as-a-judge evaluation. The next iteration in LLM products is a 24/7 thinking loop where the claude-code like thing gets input continuously from your wearable, notifications, and newsfeeds and is constantly preparing things for you.

lukaslalinsky 1mo ago
This is is already possible with Claude Code. I use a setup where I have one instance monitoring a local queue, I have a web app for receiving webhooks from various sources and pushing them to the queue. Plus email for things that don't have webhooks. That instance then decides what to do with each input, sometimes it can spawn additional agent to investigate/prepare, sometimes it creates a ticket assigned to me and then waits for me input. All of that just uses the monitoring tools built into CC. The dispatcher loop doesn't need to be extremely smart, so I might experiment replacing it with a local model like this.
- Computer0 1mo ago
  If you are willing and not too busy, What model do you use and what is your cost? (If using subscription would you be able to check with 'npx ccusage').
  - arkmm 1mo ago
    I'd also be really curious about the cost to run something like this, and what things you think it's particularly helpful for?
    - lukaslalinsky 1mo ago
      I run this on a side of the Claude Pro subscription that I use for other purposes. My main motivation was root cause analysis of production issues. I have a solo project and unfortunately my mental state has been degrading over the last years. I would avoid looking at production issues, because I didn't have the energy to focus on the investigation. So I automated this, setup the loop, setup metrics/logs access for Claude to use and now whenever something goes bad, I have a single report that I can act on easily, and if I don't, it will ping me in a way that's not spammy like automated alerts. But I'm finding more uses for it.
skybrian 1mo ago
Maybe it's my lack of imagination, but what do you imagine you'd be doing where you'd want to keep a computer busy overnight? It seems like the purpose of humans isn't to keep machines busy. When our phone or laptop is idle, it's fine if it sleeps. And when we do want something, we'd rather not wait. (Also, this new model seems to be designed to keep latency down, which is useful for interactive tasks.)
- ajam1507 1mo ago
  >It seems like the purpose of humans isn't to keep machines busy. When our phone or laptop is idle, it's fine if it sleeps. And when we do want something, we'd rather not wait. I'm not sure what the original commenter had in mind, but just because our machines are idle when we aren't using them doesn't mean that, that's how we will use computers in the future. I think notifications are an example even now of the computer not really being idle when we aren't interacting with it.
  - skybrian 1mo ago
    Notifications are designed to be low-overhead, though. I’d still like to know of specific examples for why it’s worth making your computer go burr all night, rather than asserting it will be that way just because you could.
espeed 1mo ago
Help convince Firefox of this: https://news.ycombinator.com/item?id=46294238 https://news.ycombinator.com/item?id=46294238 Rather than develop its own AI, Firefox should develop a system to pipe your html rendered browsing history in real time so external local services can process it: https://connect.mozilla.org/t5/ideas/archive-your-browser-history-and-pipe-a-stream-of-it-in-real/idi-p/103428 https://connect.mozilla.org/t5/ideas/archive-your-browser-hi.... Firefox could be the only browser that does this.
- loopmonster 1mo ago
  The fact that you've been posting this idea into the void for 8 months with no pickup is already your answer
  - gigaritee 1mo ago
    Couldn't this be implemented as a web extension? I imagine modifying singlefile to automatically send html to a local port is much easier than trying to convince a chronically mismanaged organization like mozilla (no offence to mozillians).
colingauvin 1mo ago
I've been building this for the last 6 months or so. I've basically got it working. The model is not the issue, the infra is. Keeping everything in context just isn't possible and LLMs, even Fable, don't mode switch well. To get around this I've built a database software that ingests as much digital information as possible, and annotates it, then creates timelines with resolution gradients (longer ago = less resolution) that it feeds to the LLM on every request. Then you have your cheap little MoE or ternary model just running in a loop, with an escalation pathway before it reaches the big expensive models. Currently it's doing things like reminding me to take allergy medication when I wake up because it's checked AQI or whatever, reminding me to stop at the market when I'm on my way to pick up the kids to get the cherry tomatoes I forgot, giving me heads up of what folks are expecting from me in certain meetings based on cross correlating email and calendar, etc. It's honestly the single most productive tool I've found for my ADHD.
- nateb2022 1mo ago
  Think of an LLM as a thesaurus, but for entire trains of thought rather than words. Your initial query yields something pertinent to the task at hand. But let it endlessly recurse and... you end up with something completely useless. People would do well to acquire at least a modest familiarity with what an LLM actually is. NLP is fascinating. So is entropy.
- docjay 1mo ago
  I’m curious why you don’t just use them like a Meeseeks box, rather than compressing and context stuffing into one. One only checks and categorizes your emails, another one for each category of email or even subcategory, one that only handles calendar additions, a different one to check it and notify you; you can go infinite with it. Hell, I’ll have one instance find a file and read it into the context of a different one because I don’t want a bunch of grep commands mucking up the context of the analysis. The find/read one exists for a few moments, as does the analysis one, and the ‘perform’ one is entirely different. I can run them all in parallel and use a queue if needed. I’m sure you have reasons for your setup though, so I’m curious how you landed on it.
  - 1mo ago

lukaslalinsky 1mo ago

This is is already possible with Claude Code. I use a setup where I have one instance monitoring a local queue, I have a web app for receiving webhooks from various sources and pushing them to the queue. Plus email for things that don't have webhooks. That instance then decides what to do with each input, sometimes it can spawn additional agent to investigate/prepare, sometimes it creates a ticket assigned to me and then waits for me input. All of that just uses the monitoring tools built into CC. The dispatcher loop doesn't need to be extremely smart, so I might experiment replacing it with a local model like this.

Computer0 1mo ago
If you are willing and not too busy, What model do you use and what is your cost? (If using subscription would you be able to check with 'npx ccusage').
- arkmm 1mo ago
  I'd also be really curious about the cost to run something like this, and what things you think it's particularly helpful for?
  - lukaslalinsky 1mo ago
    I run this on a side of the Claude Pro subscription that I use for other purposes. My main motivation was root cause analysis of production issues. I have a solo project and unfortunately my mental state has been degrading over the last years. I would avoid looking at production issues, because I didn't have the energy to focus on the investigation. So I automated this, setup the loop, setup metrics/logs access for Claude to use and now whenever something goes bad, I have a single report that I can act on easily, and if I don't, it will ping me in a way that's not spammy like automated alerts. But I'm finding more uses for it.

skybrian 1mo ago

Maybe it's my lack of imagination, but what do you imagine you'd be doing where you'd want to keep a computer busy overnight? It seems like the purpose of humans isn't to keep machines busy. When our phone or laptop is idle, it's fine if it sleeps. And when we do want something, we'd rather not wait. (Also, this new model seems to be designed to keep latency down, which is useful for interactive tasks.)

ajam1507 1mo ago
>It seems like the purpose of humans isn't to keep machines busy. When our phone or laptop is idle, it's fine if it sleeps. And when we do want something, we'd rather not wait. I'm not sure what the original commenter had in mind, but just because our machines are idle when we aren't using them doesn't mean that, that's how we will use computers in the future. I think notifications are an example even now of the computer not really being idle when we aren't interacting with it.
- skybrian 1mo ago
  Notifications are designed to be low-overhead, though. I’d still like to know of specific examples for why it’s worth making your computer go burr all night, rather than asserting it will be that way just because you could.

espeed 1mo ago

Help convince Firefox of this: https://news.ycombinator.com/item?id=46294238 https://news.ycombinator.com/item?id=46294238 Rather than develop its own AI, Firefox should develop a system to pipe your html rendered browsing history in real time so external local services can process it: https://connect.mozilla.org/t5/ideas/archive-your-browser-history-and-pipe-a-stream-of-it-in-real/idi-p/103428 https://connect.mozilla.org/t5/ideas/archive-your-browser-hi.... Firefox could be the only browser that does this.

loopmonster 1mo ago
The fact that you've been posting this idea into the void for 8 months with no pickup is already your answer
- gigaritee 1mo ago
  Couldn't this be implemented as a web extension? I imagine modifying singlefile to automatically send html to a local port is much easier than trying to convince a chronically mismanaged organization like mozilla (no offence to mozillians).

colingauvin 1mo ago

I've been building this for the last 6 months or so. I've basically got it working. The model is not the issue, the infra is. Keeping everything in context just isn't possible and LLMs, even Fable, don't mode switch well. To get around this I've built a database software that ingests as much digital information as possible, and annotates it, then creates timelines with resolution gradients (longer ago = less resolution) that it feeds to the LLM on every request. Then you have your cheap little MoE or ternary model just running in a loop, with an escalation pathway before it reaches the big expensive models. Currently it's doing things like reminding me to take allergy medication when I wake up because it's checked AQI or whatever, reminding me to stop at the market when I'm on my way to pick up the kids to get the cherry tomatoes I forgot, giving me heads up of what folks are expecting from me in certain meetings based on cross correlating email and calendar, etc. It's honestly the single most productive tool I've found for my ADHD.

nateb2022 1mo ago
Think of an LLM as a thesaurus, but for entire trains of thought rather than words. Your initial query yields something pertinent to the task at hand. But let it endlessly recurse and... you end up with something completely useless. People would do well to acquire at least a modest familiarity with what an LLM actually is. NLP is fascinating. So is entropy.
docjay 1mo ago
I’m curious why you don’t just use them like a Meeseeks box, rather than compressing and context stuffing into one. One only checks and categorizes your emails, another one for each category of email or even subcategory, one that only handles calendar additions, a different one to check it and notify you; you can go infinite with it. Hell, I’ll have one instance find a file and read it into the context of a different one because I don’t want a bunch of grep commands mucking up the context of the analysis. The find/read one exists for a few moments, as does the analysis one, and the ‘perform’ one is entirely different. I can run them all in parallel and use a queue if needed. I’m sure you have reasons for your setup though, so I’m curious how you landed on it.
- 1mo ago