pyentropy

6 ms·

1.
by pyentropy 4d ago
Not a Lean expert but some of the proof tactics used to prove are probably novel? Or, you could prompt agents later to analyze which lemmas or parts of the proof are surprising or applicable to other problems?
2.
Enough with all the world-historic milestones(scottaaronson.blog)
6 points by pyentropy 1mo ago|1 comments
3.
by pyentropy 1mo ago
A lot of good repos (CLIs, frameworks) had 'tree' unicode directory structure with like ├──, └──, and │ , as well as emojis for passing/failed tests and README docs maybe a unicode arrow or two, but LLMs absolutely overuse it
4.
Thoughts about the Leiden Declaration(gowers.wordpress.com)
5 points by pyentropy 2mo ago|0 comments
5.
by pyentropy 2mo ago
Vedran Miletić doesn't sound German to me! :-)
6.
by pyentropy 2mo ago
In times when software eng teams push for maximizing token usage, Tao's public view is to encourage verification, limit AI use for tasks that have real-life consequences and prevent low-effort papers that exhaust the review pipeline? H
7.
by pyentropy 2mo ago
Note that the SAIR lecture is from 6 months ago, this Beamer presentation is from 2 days ago.
8.
by pyentropy 3mo ago
I'm considering the possibility that it's good to break the prefix and cache because the LLM itself was rewarded (during post-training) with different prefixes/system prompts, each containing reasoning traces of the correct
9.
by pyentropy 3mo ago
Examples with inference of different reasoning effort levels is in the OpenAI docs as well - https://developers.openai.com/cookbook/articles/openai-harmo... https://docs.vllm.ai/en/latest&#x2F
10.
by pyentropy 3mo ago
LLM-judge/parallel branching ≠ multi-token prediction ≠ reasoning effort. See https://developers.openai.com/cookbook/articles/openai-harmo... and src/openai/types/shared/reasoning_effort.p
11.
by pyentropy 3mo ago
The number of tokens you predict at time (multi or not) has nothing to do with whether the model wants to emit any, some or a lot of reasoning tokens in reasoning tag -- similar to how branch prediction will not really change the for loop i
12.
by pyentropy 3mo ago
Take a look at the harmony repo which specifies the internal OpenAI format - the effort level is specified in the context after the <|start|> tag - https://github.com/openai/harmony Note that inference libs also
13.
Dancing to the State of the Art? How candidate lists influence LKH TSP solvers(arxiv.org)
1 points by pyentropy 1y ago|0 comments
14.
by pyentropy 2y ago
If H800 is a memory-constrained model that NVIDIA built to avoid the Chinese export ban on H100 with equivalent fp8 performance, it makes zero sense to believe Elon Musk, Dario Armodei and Alexandr Wang's claims that DeepSeek smuggled
15.
Why do I have a blog (and has it ever paid off?)(fikisipi.substack.com)
1 points by pyentropy 2y ago|1 comments
16.
by pyentropy 2y ago
You should start a blog... or maybe not - pursue the battle in academia/work and occasionally drop nuggets of wisdom like this somewhere. But do not delete them.
17.
Busy Beaver, the current BB(5) conjecture and bbchallenge.org(fikisipi.substack.com)
1 points by pyentropy 2y ago|0 comments
18.
by pyentropy 2y ago
I updated the post with a a link to counter-argument from Sabine Hossenfelder, the arguments from Zvi and three points from my side.
19.
by pyentropy 2y ago
I updated the post with a a link to counter-argument from Sabine Hossenfelder, the arguments from Zvi and three points from my side.
20.
by pyentropy 2y ago
Scott worked at OpenAI Safety and he likes it: https://scottaaronson.blog/?p=8047 But is the "-ed" in worked a problem?
21.
by pyentropy 2y ago
Thank you.
22.
by pyentropy 2y ago
It is a question. I tried to put what my opinion is on a few statements but I absolutely cannot summarize 160 pages (Business Insider did using GPT, which I find insulting and funny) nor have a 100% opinion on something that involves nation
23.
Is Aschenbrenner's 165 page paper on AI the naivety of a 25 year old?(fikisipi.substack.com)
44 points by pyentropy 2y ago|68 comments
24.
Short post: A look at Devin, the AI-powered software engineer(fikisipi.substack.com)
4 points by pyentropy 3y ago|0 comments
25.
My 2023 prediction mistakes and the new Metaculus scoring function(fikisipi.substack.com)
2 points by pyentropy 3y ago|0 comments
26.
by pyentropy 3y ago
You haven't read Scott's blog enough :) He's an atheist psychiatrist. However, he enjoys how natural selection, social dynamics and reputation can also be modeled by the moral rules of most religions. For example, going to th
27.
Time.mk: disrupting the Macedonian online media using clustering algorithms(fikisipi.substack.com)
2 points by pyentropy 3y ago|0 comments
28.
Doing cheap PyTorch inference with Modal.com(fikisipi.substack.com)
6 points by pyentropy 3y ago|0 comments
29.
by pyentropy 3y ago
Fun fact: jgc (John Graham-Cumming) is the person that started the petition that forced the UK government to publicly apologize for its harsh treatment and persecution of Alan Turing.
30.
by pyentropy 3y ago
The character limit incentivizes content that's polarizing and evokes strong emotions, because you are competing for attention without the ability to express subtleties/details.

More ›