derekcheng08

6 ms·

1.
by derekcheng08 5mo ago
They have a public dataset of 6000, real world coding agent sessions. About 80% of them are Claude Code. Lots of cool analyses to be done on these.
2.
SWE-Chat: Coding Agent Interactions from Real Users in the Wild(swe-chat.com)
2 points by derekcheng08 5mo ago|1 comments
3.
by derekcheng08 5mo ago
I built Prism this morning. It runs a tiny 500M parameter LLM in your browser on a given piece of text and visualizes the entropy of the probability distribution computed for each token -- effectively how confident the model is in predictin
4.
Show HN: Visualize token entropy in a tiny in-browser LLM(tonkotsu-ai.github.io)
1 points by derekcheng08 5mo ago|1 comments
5.
Managing Unreliable Compilers(blog.tonkotsu.ai)
7 points by derekcheng08 8mo ago|4 comments
6.
by derekcheng08 9mo ago
After analyzing thousands of agent trajectories, we’ve seen all sorts of bizarre LLM quirks, this being one of them. Would love to hear other war stories also!
7.
"I've failed 17 times with the exact same error": An agent debugging tale(blog.tonkotsu.ai)
2 points by derekcheng08 9mo ago|1 comments
8.
by derekcheng08 10mo ago
Pretty cool! Always struck me as odd that the IDE has largely remained single-player for 40 years.
9.
by derekcheng08 10mo ago
That was an insane time. The pace was unreal. I remember Netscape 2.0 had at least 6-7 beta releases prior to the full release. And each one just dropped something massive and fundamental to the Internet - JavaScript (then called LiveScript
10.
by derekcheng08 10mo ago
Super interesting how this arc has played out for Microsoft. They went from having this massive advantage in being an early OpenAI partner with early access to their models to largely losing the consumer AI space: Copilot is almost never me
11.
by derekcheng08 10mo ago
The biggest omission that immediately stands out to me is: "provides a clear sense of direction". I've seen so many examples of teams and organizations that experience a lack of clarity, with all sorts of negative downstream
12.
by derekcheng08 11mo ago
I do really like Tonkotsu :) But beyond that, we wanted a playful, accessible brand. We think dev tools (particularly ones like Tonkotsu) are consumer products and we didn't want the staid/corporate branding many tools have.
13.
by derekcheng08 11mo ago
Forgot to mention that an interesting behavior we see emerging is “human as editor”: let the agents make several commits in a branch, and then the human does a single refinement pass over it before raising a PR. Curious if others use this w
14.
Show HN: Tonkotsu – a developer app for managing a team of AI coding agents(tonkotsu.ai)
3 points by derekcheng08 11mo ago|4 comments
15.
by derekcheng08 1y ago
Is it model quality or the CLI itself?
16.
by derekcheng08 1y ago
Cool, but at the same time, it feels overwhelming: so many different CLI or IDE tools, so many extension points. It will be fascinating to see how this all shakes out.
17.
by derekcheng08 1y ago
Really feels like computer use models may be vertical agent killers once they get good enough. Many knowledge work domains boil down to: use a web app, send an email. (e.g. recruiting, sales outreach)
18.
by derekcheng08 1y ago
Fascinatingly deep study. It shows the hyperoptimization needed to build these businesses: from all the work needed to calibrate pricing for each country, to technical safeguards like the fingerprinting. A lot of work had to be done here.
19.
by derekcheng08 1y ago
I suspect there are many, many things for which chat is a great interface. And by positioning ChatGPT as the distributor for all these things, they get to be the new Google. But you're also right that many domains for which a purpose-b
20.
by derekcheng08 1y ago
What a fun blast from the past! I fondly remember real-time at Waterloo. If nothing else, it taught you how to project-manage/time-manage so you could write a project of tens of thousands of lines of code in a four month term.
21.
by derekcheng08 1y ago
Just based on usage, I would assume js/ts would be very valuable as well. I see a lot of the same issues there and agree the core algos seem to apply generally. Very cool project!
22.
by derekcheng08 1y ago
LOL came here to say this exactly. Everyone LOVES war stories in my experience :)
23.
by derekcheng08 1y ago
This is pretty awesome! If it's built on tree-sitter, is it fair to assume it's generalizable across languages?
24.
by derekcheng08 1y ago
AI is (or has the potential to be) a gigantic abstraction layer and software engineering is filled with abstraction layers. But one thing that has consistently held true is that the best engineers -- while taking advantage of abstractions -
25.
by derekcheng08 1y ago
Interesting. I wonder if you could implement tool calling with this approach so the LLM calls the tool with the formal specification and gets back the result. Just like a coding agent can run a compiler, get back errors and then self-correc
26.
by derekcheng08 1y ago
I suspect in this case, enterprise adoption of chat-based AI is downstream from consumer adoption. Like many things, trendsetting/taste-making happens on the consumer side and then comes to enterprise. ChatGPT was first to the consumer