nyellin

8 ms·

1.
by nyellin 1mo ago
Author of the original here. Thank you for the mention!
2.
by nyellin 2mo ago
No, because every article will devolve into a discussion on if AI generated or not, and to what degree. Let content speak for itself.
3.
by nyellin 3mo ago
OP here and the doctor was wonderful. If we fixed the interface they could help more patients in the same time.
4.
by nyellin 3mo ago
It's a trade-off. In these scenarios we update our staging data for next time.
5.
by nyellin 3mo ago
How does copy pasting an error into an LLM involve thinking?
6.
by nyellin 3mo ago
I'm the OP and wanted to clarify. We do not give Claude Code access to production API keys. The intent was staging databases and I've updated the post to make it more clear. We assume that every API key we put into Claude Code can
7.
by nyellin 3mo ago
I'm the OP and this is the exact point of the post. Whoever handed you that project did not have Claude code running it end to end in a production-like environment. Whether you like the vibe coded app or not, you would have had fewer e
8.
by nyellin 3mo ago
As written elsewhere, we dont give access to prod! The DBs are staging and our assumption is that every key we give Claude will be leaked. I'll update the post to clarify
9.
by nyellin 3mo ago
Fair enough, I will update
10.
by nyellin 3mo ago
I'm the OP and to clarify we dont give access to prod DBs. The point is you need to give the LLM the ability to test end to end, and that can be done with staging data.
11.
by nyellin 3mo ago
OP here: we don't give Claude Code access to prod. Everything is isolated cloud accounts for this purpose. E.g. we give Claude credentials for db - but it's never prod data.
12.
You shouldn't copy-paste errors into Claude Code(home.robusta.dev)
36 points by nyellin 3mo ago|68 comments
13.
How to Drive an LLM(home.robusta.dev)
3 points by nyellin 3mo ago|0 comments
14.
by nyellin 3mo ago
No, it was designed on paper by someone with no understanding of prompt caching and no consideration of latency or token costs
15.
by nyellin 5mo ago
Why does Atlassian need to train AI models?
16.
Ask HN: Agent orchestrators / UIs you use on top of Claude?
2 points by nyellin 5mo ago|1 comments
17.
by nyellin 5mo ago
Is it possible to run a Kubernetes cluster inside one? (E.g. via KIND.) If so, we'd very much like to test this. We make extensive use of Claude Code web but it can't effectively test our product inside the sandbox without running
18.
Ask HN: Giving AI agents a credit card
2 points by nyellin 7mo ago|0 comments
19.
by nyellin 8mo ago
We publish the benchmarks for HolmesGPT (CNCF sandbox project) at https://holmesgpt.dev/development/evaluations/
20.
by nyellin 8mo ago
HolmesGPT maintainer here: our benchmarks [1] tell a very different story, as does anecdotal evidence from our customers- including Fortune 500 using SRE agents in incredibly complex production environments. We're actually struggling a
21.
by nyellin 8mo ago
Haiku is called often, but not always the way you think. E.g. every time you write something CC invokes Haiku multiple times to generate the 'delightful 1-2 word phrase used to indicate progress to the user' (Doing Stuff, Wizardin
22.
by nyellin 8mo ago
Not necessarily true. Subagents allow for parallelization but they can decrease accuracy dramatically if you're not careful because there are often dependencies between tasks and swapping context windows with a summary is extremely los
23.
by nyellin 8mo ago
Forgot to address the easiest part: > - how can I reliably call tools with the right schema? This is typically done by enabling strict mode for tool calling which is a hermetic solution. Makes llm unable to generate tokens that would vio
24.
by nyellin 8mo ago
Re (1) use a TODOs system like Claude code. Re (2) also fairly easy! It's just a summarization prompt. E.g. this is the one we use in our agent: https://github.com/HolmesGPT/holmesgpt/blob/62c3898e4efae69
25.
by nyellin 8mo ago
There's a bit more to it! For example, the agent in the post will demonstrate 'early stopping' where it finishes before the task is really done. You'd think you can solve this with reasoning models, but it doesn't a
26.
Show HN: HolmesGPT – OSS AI Agent for On-Call and Observability(github.com)
2 points by nyellin 1y ago|0 comments
27.
by nyellin 2y ago
I know there are already a number of comments here about proprietary solutions. If you're looking for something open source: https://github.com/robusta-dev/holmesgpt/
28.
Show HN: We released an AI Agent for Prometheus alerts and on-call(github.com)
1 points by nyellin 2y ago|0 comments
29.
by nyellin 2y ago
Here you go: https://www.youtube.com/live/Jml1hk6I5Wo?si=YbjJKRkO4yf0bOlx And thanks for submitting!
30.
by nyellin 2y ago
We've open sourced something with similar goals that you can use today: https://github.com/robusta-dev/holmesgpt/ We're taking a slightly different angle than what Facebook published, in that we're

More ›