andyk

6 ms·

1.
by andyk 23d ago
> bingeineering i'm gonna start using this
2.
by andyk 23d ago
because it seems like the human mind does this and it was easy to start with. The human mind obviously also compresses by other dimensions so we'll keep experimenting suggestions for what to try next?
3.
by andyk 23d ago
fair point. the headlong agent running on my mac mini, cleo, doesn't pause between calls to "generate next thought". for a while the implementation didn't support pausing between thoughts. a `thinker`, which is where th
4.
by andyk 23d ago
Should maybe have said more loudly in the posts that this is not intended to be disciplined engineering (or used in prod!) we did think about the architecture quite a bit and we've tried a bunch of different things out. We are fully
5.
by andyk 23d ago
andy here (headlong post author). terminal bench 3 is pretty popular for comparing different harnesses using the same underlying model (it's another laude project actually). artificial analysis has an index. you can look at the model
6.
by andyk 23d ago
andy here - happy to answer questions
7.
by andyk 2y ago
I hope the competition will inspire people to make breakthroughs in the open, so I won't take any rights to the IP, instead the winning solutions must use open source code and open weight models.
8.
by andyk 2y ago
yes the prize money is from me to the winners
9.
by andyk 2y ago
That has a double meaning - half tongue in cheek. 1) since we are creating a contamination-free version of SWE-bench (i.e. scraping a new test set after submissions are frozen) it is guaranteed that agents in this contest can't "c
10.
by andyk 2y ago
(reposting from locallama and lower down here) yep that's true. one of my goals is to inspire and honor those that work on open source AI. Those people tend to be motivated by things like impact and the excitement of being part of some
11.
by andyk 2y ago
andy here - happy to answer questions. Also, I answered a bunch of questions yesterday on LocalLLaMA that people here might find interesting https://www.reddit.com/r/LocalLLaMA/comments/1hdfng5/ill_giv...
12.
by andyk 2y ago
yeah i agree. one of my goals is to inspire and honor those that work on open source AI. people who work on open source tend to be motivated by things like impact and the excitement of being part of something bigger than themselves - at lea
13.
Pplx and Dbrx founder giving $1M to first OSS AI that gets 90% on SWE-bench(twitter.com)
1 points by andyk 2y ago|3 comments
14.
by andyk 2y ago
I tweeted this on stage at NeurIPS on weds: "I'll give $1M to the first open source AI that gets 90% on this sweet new contamination-free version of SWE-bench - http://kprize.ai " - K Prize is a new kaggle competit
15.
#1 agent on swe-bench wrote 7% of its own code(aider.chat)
9 points by andyk 2y ago|1 comments
16.
by andyk 2y ago
done! in the "Alternatives and related projects" section I just added to the ht readme -- https://github.com/andyk/ht/blob/main/README.md#alternatives...
17.
by andyk 2y ago
Sorry, my wording wasn't very clear. I wasn't trying to imply that ht is more geared towards scripting than `expect` (in fact I'd say `expect` is more scripting-oriented being an extension of a scripting language) but rather
18.
by andyk 2y ago
I tried to contrast to `expect` in a couple of my other responses, but yeah this is my sense too after looking briefly at `expect` - that ht always transparently sets up a terminal for you under the hood and you interact with that so you ca
19.
by andyk 2y ago
andyk here. it's clear our readme is lacking use cases! adding some now. When we introduced ht on twitter I gave a little more context -- https://x.com/andykonwinski/status/1796589953205584234 -- but that sho
20.
by andyk 2y ago
thanks for surfacing `expect` to our attention. I'll add a compare/contrast to the ht readme
21.
by andyk 2y ago
Interesting. When we decided to build ht we didn't compare it to expect (which I hadn't heard of or used) but I'm comparing the two now as they seem related. How exactly did `expect` fall over? From what I can tell, expect do
22.
by andyk 2y ago
Include in your input json the ascii control character that the keyboard combo would generate (e.g., \x03 for ctrl-c). To send control-c to the terminal, for example, you'd send the following JSON message to ht: { "type":
23.
by andyk 2y ago
Yep this was my main reason for wanting it, though lots of other good ideas in these HN comments.
24.
by andyk 2y ago
I shared the motivating use case for why Marcin and I built this (LLM agents using terminals) in a diff comment but I’ll also expand the readme to give examples of use cases.
25.
by andyk 2y ago
Oh this is cool. I looked at using tmux before we built ht because I’ve used screen and tmux forever. I didn’t find libtmux though. Will def check it out.
26.
by andyk 2y ago
Hey, project lead here. I had a very specific use case in mind: I’m playing with using LLM agent frameworks for software engineering - like MemGPT, swe-agent, Langchain and my own hobby project called headlong ( https://github.com
27.
Headless Terminal – making terminals easy for LLMs to use(twitter.com)
1 points by andyk 2y ago|0 comments
28.
by andyk 2y ago
I just read that article and enjoyed it. Thanks for sharing! I don’t think the author was arguing biological processes can’t be reverse engineered, but rather that the tools and approaches typically used by biology researchers may not be as
29.
AI benchmarks should be like unit tests(andykonwinski.com)
2 points by andyk 2y ago|0 comments
30.
OpenAI Dropped Work on New 'Arrakis' AI Model in Rare Setback(theinformation.com)
4 points by andyk 3y ago|3 comments

More ›