montebicyclelo

5 ms·

1.
by montebicyclelo 29d ago
More fragmented sleep, with people talking in the night, etc. I guess that's different from the low, unnatural, rumbles of cars and aeroplanes the majority of people have to put up with.
2.
by montebicyclelo 1mo ago
Really cool work. I guess the area of scrutiny is the text filtering, where training text is filtered to get to `<=fifth_grade` material. I would have liked to have seen examples of what is in this training set, but paper [1] seems to on
3.
by montebicyclelo 1mo ago
Apparently, the French typically start with "no" because it leaves them room to say "yes" later, which is harder to go back on. > “Answering ‘non’ gives you the option to say ‘oui’ [yes] later; [it’s] the opposite whe
4.
by montebicyclelo 1mo ago
Cool doc, thanks for sharing. Amazingly, a quick search brought up one of the articles they were shown setting (from the few words mentioned): https://www.nytimes.com/1978/07/01/archives/150-hurt-as-truc.
5.
by montebicyclelo 1mo ago
worth noting you don't usually read _that_ many books in your lifetime. e.g. 20 a books a year for 40 years is just 800 books side note: i've noticed people writing with no caps, unusual grammar, splling mistakes, etc. which does
6.
by montebicyclelo 1mo ago
Did the ycombinator podcast which included giving advice to startup founders just a few days ago: https://www.ycombinator.com/library/Vy-jeff-dean-the-1-rule-...
7.
by montebicyclelo 2mo ago
The article is heavily leaning on the paper "The Illusion of Thinking" [1]. It could be boiled down to: in 2025 this paper showed that "thought traces" in the models of the time could sometimes be inaccurate or misleadin
8.
by montebicyclelo 2mo ago
I was wondering whether this might have an explanation for why I don't really like major music, preferring minor / modal / non-functional harmony... it does: > Throughout this derivation of different chords, you will note
9.
by montebicyclelo 2mo ago
Fun, and enjoyed the track it uses: https://music.youtube.com/watch?v=-tJ23mRbmps
10.
by montebicyclelo 3mo ago
Hmm, there's a difference between unnecessary arguments about every tiny detail, and productive arguments. I've seen many healthy technical disagreements; often leading to new insights coming to light, assumptions being made expli
11.
by montebicyclelo 3mo ago
> Then cite them as blog posts My point is it's still useful to have a somewhat authoritative place to cite (high quality) blog post level content. arXiv has formatting requirements and doesn't go down like random personal site
12.
by montebicyclelo 3mo ago
Well, some blog posts are worth citing.
13.
by montebicyclelo 3mo ago
Isn't the directionality important. I.e. it is currently possible to run useful / great models locally, but on high end machines; and in a few years we will likely be able to run even better models on standard machines.
14.
by montebicyclelo 3mo ago
"why not alternative", would be better framed as, "here's a fun variation" — because both approaches are just playing around with technology, for fun / curiosity / exploration. Storing in the pixels is a f
15.
by montebicyclelo 5mo ago
Ever considered second hand slightly older gens? Even M1 is still great for many use cases. E.g. often corps are selling them on Ebay, in pretty good condition.
16.
by montebicyclelo 8mo ago
Reminds me of this [1] HN post from 9 months ago, where the author trained a neural network to do world emulation from video recordings of their local park — you can walk around in their interactive demo [2]. I don't have access to the
17.
by montebicyclelo 8mo ago
Originally wrote this in 2022 to improve my understanding of deep learning internals. Recently refreshed it, removing CuPy to keep it lighter and educational. (Plus modernized the stack, e.g. with uv and improved CI.)
18.
Show HN: SmallPebble – minimalist deep learning library in <1000 lines of Python(github.com)
2 points by montebicyclelo 8mo ago|1 comments
19.
by montebicyclelo 8mo ago
For an example of an AI generated song that's gone viral in the last few days, getting millions of views on Spotify / Youtube, see this post from earlier today: "Tell HN: Viral Hit Made by AI, 10M listens on Spotify last few
20.
by montebicyclelo 8mo ago
Yep, it is convincing. And it seems the video is performed by a human, although I did think it could be AI. They say in the description: > I couldn't resist putting a face to this gem. After saying it is AI: > How people was touc
21.
Tell HN: Viral Hit Made by AI, 10M listens on Spotify last few days
4 points by montebicyclelo 8mo ago|5 comments
22.
by montebicyclelo 10mo ago
As a hobbyist, shaders is up there as one of the most fun types of programming.. Low-level / relatively simple language, often tied to a satisfying visual result. Once it clicks, it's a cool paradigm to be working in, e.g. "I
23.
by montebicyclelo 11mo ago
bulk_send( generate_expiry_email(user) for user in db.getUsers() if is_expired(user, date.now()) ) (...Just another flavour of syntax to look at)
24.
by montebicyclelo 11mo ago
Incorrect Pytorch gradients with Apple MPS backend... Yep this kind of thing can happen. I found and reported incorrect gradients for Apple's Metal-backed tensorflow conv2d in 2021 [1]. (Pretty sure I've seen incorrect gradients w
25.
by montebicyclelo 11mo ago
Agreed, and its larger context window is fantastic. My workflow: - Convert the whole codebase into a string - Paste it into Gemini - Ask a question People seem to be very taken with "agentic" approaches were the model selects a fe
26.
by montebicyclelo 11mo ago
At your own risk — one place is ebay sellers with a large number of positive reviews, (and not much negative), who are selling lots of the same type of MacBook pros. My assumption is they've got a bunch of corporate laptops to sell off
27.
by montebicyclelo 11mo ago
On the contrary; now might be a good time to get an M1 Max laptop. A second hand one, ex-corporate, in good condition, with 64Gb RAM, is pretty good value, compared to new laptops at the same price. It's still a fantastic CPU.
28.
by montebicyclelo 11mo ago
> nanochat is also inspired by modded-nanoGPT Nice synergy here, the lineage is: Karpathy's nano-GPT -> Keller Jordan's modded-nanoGPT (a speedrun of training nanoGPT) -> NanoChat modded-nanoGPT [1] is a great project, we
29.
by montebicyclelo 1y ago
I did the same. I was sad to lose the comments, but the ads were awful and I don't particularly want someone elses ads / tracking on my hobby site. I switched to gisqus [1], which is powered by GitHub discussions, which seems to b
30.
by montebicyclelo 1y ago
> One of the simplest CRDT strategies is Last-Write-Wins (LWW): > Each update gets a timestamp (physical or logical). > When two devices write to the same field, the update with the latest timestamp wins. Please also have a robust

More ›