BenoitEssiambre

6 ms·

1.
by BenoitEssiambre 9d ago
Reducing entropy or cross entropy fits intuition and theory and it's what LLMs target during training in order to model languages, to model the world and to enable calibrated reasoning across uncertainty and gray areas. I think you can
2.
by BenoitEssiambre 2mo ago
The benefits go beyond reducing token consumption. Compact contexts also foster better reasoning, enable intelligence across more layers if you can load them in a single context, and writing software to enable this, results in more correct
3.
by BenoitEssiambre 3mo ago
Looks like a good model (sir). Costs are getting out of control though. 2x Opus and non-metered usage going away. We're quickly approaching the cost of a human salary for normal usage.
4.
by BenoitEssiambre 4mo ago
Attempts to impose always small PRs might get me to argue that optimal change sizes are normally distributed. If you look at how simulated annealing ( https://en.wikipedia.org/wiki/Simulated_annealing ) is done, while th
5.
The software industry: annealing, but wrong(apenwarr.ca)
4 points by BenoitEssiambre 4mo ago|1 comments
6.
The Era of Compounding Language(benoitessiambre.com)
2 points by BenoitEssiambre 6mo ago|0 comments
7.
by BenoitEssiambre 7mo ago
If you're at a place that rewards complexity, you might be able to pitch simplicity as something that to get right, requires deep understanding of complex information theoretic concepts and deep understanding of ontological knowledge a
8.
by BenoitEssiambre 7mo ago
One underrated reason that CLIs are often better than MCP is that Unix tools seem to have close to information theoretically optimal layout to enabled reasoning. They are concise, in the Solomonoff/Kolmogorov sense. This means that the
9.
by BenoitEssiambre 8mo ago
Yeah I always wondered if I ever switched to solar panels, would there be a way to accumulate heat to be used in the Canadian cold months that have little sunlight? The closest I found was electric thermal storage based on heating bricks. T
10.
by BenoitEssiambre 8mo ago
This matches my intuition. Systematic misalignment seems like it could be prevented by somewhat simple rules like the hippocratic oath or Asimov's Laws of robotics or rather probabilistic bayesian versions of these rules that take into
11.
by BenoitEssiambre 8mo ago
Wouldn't this have been more readable with a \n newline instead of a pipe operator as a seperator? This wouldn't have made the prompt longer.
12.
by BenoitEssiambre 8mo ago
Countries are waking up to the danger of having the US in a position to take control of most of their computers and phones via software updates. Open source solutions like https://en.wikipedia.org/wiki/GendBuntu could
13.
The Unreasonable Effectiveness of Failure(benoitessiambre.com)
4 points by BenoitEssiambre 8mo ago|0 comments
14.
by BenoitEssiambre 8mo ago
It could be just an owner or a board or directors at the top. It's possible the CEO will be automated for some companies.
15.
by BenoitEssiambre 8mo ago
I also mean Hacker News
16.
by BenoitEssiambre 8mo ago
AI CEOs are coming.
17.
by BenoitEssiambre 8mo ago
Its founder lives in europe so there's that.
18.
by BenoitEssiambre 8mo ago
It is a sad reality. The US has recently threatened to annex Denmark and Canada. Some of us are suddenly keenly aware that the US is in a position to take control of most of our computers and phones via software updates. Open source is the
19.
by BenoitEssiambre 8mo ago
For consumers, these computers look interesting: https://starlabs.systems/
20.
by BenoitEssiambre 8mo ago
I know doctors who've worked with Marrero and they seem to be split in their opinion. They seem to agree he tends to be "excessively thorough", frequently sending tests to labs across the world. This makes him liked by desper
21.
by BenoitEssiambre 8mo ago
Right but the majority of people holding significant amounts of capital is retirees or people saving for retirement. There is a small minority of people wealthy for other reasons. It doesn't really make sense to strongly associate thes
22.
by BenoitEssiambre 8mo ago
Do you have a link? What I've seen in most discussions is obscuring of the fact that the majority of "capital" is directly or indirectly retirees or people saving for retirement. Those in the top 5% wealthiest often need to
23.
by BenoitEssiambre 8mo ago
Note that the "Labor vs Capital" distinction mostly means "workers vs retirees". The reason more money goes to capital these days is not necessarily that each retiree is getting more but that in an aging population, ther
24.
by BenoitEssiambre 10mo ago
If you click on the link, I mention other competing attempts and architectures, like Multics, Hurd, MacOS and even early Windows that either failed or started adopting Unix patterns.
25.
by BenoitEssiambre 10mo ago
Unix and Linux would be your quintessential examples. Unix was an effort to take Multics, an operating system that had gotten too modular, and integrate the good parts into a more unified whole (book recommendation: https://www.a
26.
by BenoitEssiambre 10mo ago
So which base style and tone simply gives you less sycophancy? It's not clear from their names and description. I'm looking for the "Truthful" personality.
27.
by BenoitEssiambre 10mo ago
At least nickels should go so we can always round by one digit.
28.
by BenoitEssiambre 1y ago
Yeah, the example with the eggs isn't great because an LLM would indeed get the correct interpretation but the thing is, this is based on LLMs having been trained on the context. When and LLM has the context, it is usually able to corr
29.
by BenoitEssiambre 1y ago
A CLI might be the most information theoretically efficient form of API, significantly more succinct than eg. JSON based APIs. It's fitting that it would be optimal for Claude Code given the origin of the name "Claude". Infor
30.
by BenoitEssiambre 1y ago
To add to this, there are fundamental information-theoretic principles that support inlining code and components. It's about reducing code entropy, reducing length and referential distances. https://benoitessiambre.com/

More ›