jakozaur

5 ms·

1.
Hackathons in the vibe coding era: our token economics experiment(quesma.com)
3 points by jakozaur 1d ago|0 comments
2.
by jakozaur 5d ago
I believe RTK would work well in that use case. Sometimes creating less verbose variants yourself (a simple script, build.sh, with pointers to logs) can be a quick win.
3.
by jakozaur 8d ago
The drop is not uniform; see Table I.2.6 (2022 -> 2025). Focusing on math: Stable, above OECD average: Taiwan, Macao, Korea, Estonia, United Kingdom, Poland, Lithuania, Italy, New Zealand Stable, around or below OECD average: United Stat
4.
by jakozaur 17d ago
Somewhat similar to the Claude Cowork pattern; Cowork is one toggle away from Chat. Also follows the Grok Bot of an advanced computer use. OpenClaw for normies.
5.
by jakozaur 19d ago
I tried it with a less typical case (the Warsaw, Poland transit app). I'm impressed that it worked at all and got quite far. Though it is still broken in many ways (random geo locations), the menu bar on top... The problem is that many
6.
OpenAI Codex pricing: the $270 PR a $200/month sub covers daily(quesma.com)
3 points by jakozaur 19d ago|0 comments
7.
by jakozaur 21d ago
Two events: Anthropic did end up paying a $1.5B settlement for a case involving the use of pirated books. See Bartz v. Anthropic. Second, apparently archiving content and providing it to others is risky business. It is often ruled as pirac
8.
by jakozaur 21d ago
AWS rarely acquired startups, though leveraging someone else's tech is a typical pattern. It did license ParAccel and sold it as Redshift. It also runs Athena, which is based on Trino (a Presto fork). Now, with Snowflake and Databricks
9.
by jakozaur 21d ago
I wish AI leaders would fund more data archival projects, instead of hoarding it themselves. They could build a lot of goodwill, but the current state of the art is destroying old books and denying anyone access to them. These archival proj
10.
by jakozaur 1mo ago
Yes, in the linked sources, SemiAnalysis did test for Codex too: https://x.com/SemiAnalysis_/status/2064815044085318040 Similar effect, but even 70 times higher compared to Claude, 40 times.
11.
Claude Code pricing: same tokens, same model, up to 40x the price(quesma.com)
31 points by jakozaur 1mo ago|10 comments
12.
Tokenflation: When "Hi" triggers 33 tool calls(quesma.com)
6 points by jakozaur 2mo ago|1 comments
13.
by jakozaur 2mo ago
This isn’t limited to large system prompts. Coding-agent harnesses are also becoming more aggressive about using tools, even for trivial requests. In our tests, prompts such as “Hey” or “commit” sometimes triggered 30+ tool calls: https:&#
14.
by jakozaur 2mo ago
Fable is also extended by another week till July 19: https://support.claude.com/en/articles/15424964-claude-fable...
15.
Make Europe Cool Again(jacek.migdal.pl)
6 points by jakozaur 2mo ago|0 comments
16.
by jakozaur 3mo ago
It's rather hard to do at the proxy level with agentic coding, such as Claude Code or similar. These are long-chained sessions of tool use that heavily rely on prompt caching. Changing mid-flight is costly. It looks like much more cont
17.
by jakozaur 4mo ago
Poland's first partly free election was on 4 June 1989, preceded by the roundtable negotiations. The protests in Czechoslovakia came later, called the Velvet Revolution, from 17 to 28 November 1989. In June 1990, Czechoslovakia held it
18.
by jakozaur 4mo ago
The story is longer: Poland was the first country to make a remarkable peaceful transition from a bankrupt, failed Soviet satellite state. The shock therapy, plus NATO and EU aspirations, paved the way. It is a story of a country that made
19.
by jakozaur 5mo ago
A heat pump could win as the best HVAC technology, though a better drilling for ground-sourced ones. Just a shallow drilling (up to 100m) that works in retrofit mode, such as drilling from the basement, would be a great upgrade: - No outdoo
20.
by jakozaur 6mo ago
Build systems are tested by CompileBench (Quesma's benchmark). Disclaimer: I'm the founder.
21.
by jakozaur 7mo ago
I can provide trajectories. Though probably we are not going to publish them this time. This would need some extra safeguards. Email me. The address is in profile.
22.
by jakozaur 7mo ago
As I do eval and training data sets for living, in niche skills, you can find plenty of surprises. The code is open-source; you can run it yourself using Harbor Framework: git clone git@github.com:QuesmaOrg/BinaryAudit.git export OPENR
23.
by jakozaur 7mo ago
So many models refuse to do that due to alignment and safety concerns. So cross-model comparison doesn't make sense. We do, however, require proof (such as providing a location in binary) that is hard to game. So the model not only has
24.
by jakozaur 7mo ago
Oh, nice find... We end up using PyGhidra, but the models waste some cycles because of bad ergonomics. Perhaps your cli would be easier. Still, Ghidra's most painful limitation was extremely slow time with Go Lang. We had to exclude th
25.
by jakozaur 7mo ago
See direct benchmark link: https://quesma.com/benchmarks/binaryaudit/ Open-source GitHub: https://github.com/QuesmaOrg/BinaryAudit
26.
We hid backdoors in ~40MB binaries and asked AI + Ghidra to find them(quesma.com)
245 points by jakozaur 7mo ago|98 comments
27.
by jakozaur 7mo ago
Funny thing, AI is not that terrible at using Ghidra. We released a benchmark on that and hopefully models will improve: https://quesma.com/blog/introducing-binaryaudit/
28.
by jakozaur 7mo ago
Funny coincidence, I'm working on a benchmark showcasing AI capabilities in binary analysis. Actually, AI has huge potential for superhuman capabilities in reverse engineering. This is an extremely tedious job with low productivity. Cu
29.
by jakozaur 8mo ago
Great idea. Currently, people have to rely on client-side spans in OpenTelemetry. However, it would be awesome if we could get spans for slow SQL queries, along with explanations.
30.
by jakozaur 8mo ago
In this benchmark, micro-services are really small, ~300 lines, and sometimes just two of them. More realistic tasks (large codebases, more microservices) would have a lower success rate.

More ›