hackpert

5 ms·

1.
by hackpert 6mo ago
We found evidence of specific layer-localized "reasoning" circuits in a few models last year too! A very much work-in-progress paper is here: https://openreview.net/forum?id=mTjGBrkdtz
2.
by hackpert 8mo ago
Huh there is so much limonene in Coca Cola?! Limonene works as a very good…pesticide and herbicide! I did a research project on limonene like 10 years ago with my mentor and it outperformed most commercial pesticides in controlled settings.
3.
by hackpert 8mo ago
These metaphorical database analogies bug me, and from what it seems like, a lot of other people in comments! So far some of the most reasonable explanations I have found that take training dynamics into account are from Lenka Zdeborova&#x2
4.
by hackpert 10mo ago
Hi! Did you ever end up running this reproduction? If yes, could you also check if the Putnam/IMO problems are in the training data perhaps by trying to have it complete the problems n times? I would totally do this myself if I weren’t
5.
by hackpert 1y ago
O
6.
by hackpert 2y ago
If anyone else is curious about which ARC-AGI public eval puzzles o3 got right vs wrong (and its attempts at the ones it did get right), here's a quick visualization: https://arcagi-o3-viz.netlify.app
7.
by hackpert 2y ago
Sorry never mind! I wasn't thinking at all when I wrote that thought, but that obviously doesn't make sense :)
8.
by hackpert 2y ago
That's fair but what if you could estimate the direction of incoming light with other sensors? Using inverse diffraction etc. Just a thought
9.
by hackpert 2y ago
Hi! I've been working on theorem proving systems for some time now. I would love to help out with an AlphaProof reproduction, but I can't reach you on discord for some reason!
10.
by hackpert 2y ago
Thank you, those insights are invaluable! This is a specific and potentially dumb question and I completely understand if you can't answer it! The practical motivation for MoEs is very clear but I do worry about loss of compositional a
11.
by hackpert 2y ago
I'm not sure how to quantify how quickly or well humans learn in-context (if you know of any work on this I'd love to read it!) In general, there is too much fluff and confusion floating around about what these models are and are
12.
by hackpert 3y ago
There has been some interesting work when it comes to distributed training. For example DiLoCo ( https://arxiv.org/abs/2311.08105 ). I also know that Bittensor and nousresearch collaborated on some kind of competitive di
13.
by hackpert 3y ago
I tried to do this ages ago in 2018 by adapting OpenAI's flow architecture and it sort of seemed to work (was at least promising). With today's models with a significantly more disentangled latent space it should be much easier to
14.
by hackpert 3y ago
Wow I had hoped for a more productive discussion than these 1-1 comparisons of Bard vs ChatGPT that I'm seeing everywhere. The model deployed with this version of Bard is clearly a smaller model than the biggest LaMDA/PaLM models
15.
by hackpert 4y ago
I've been using Metaphor for a few weeks now and have almost entirely switched from Google and other search engines. Keyword based search simply doesn't come close when it comes to getting the _right_ results. While I have to sift
16.
by hackpert 4y ago
Right, but doesn't that mean that it could potentially be used for designing algorithms that have componentwise numerical stability over some kind of floating point standard, but this, by definition being a result over finite fields, s
17.
by hackpert 4y ago
While your point about numerical stability is correct in general, there are no numerical stability issues here and I think this conception, which I've seen in more than one place now, stems from a fundamental misunderstanding of the pa
18.
by hackpert 4y ago
UPI's penetration in (urban and semi-urban anyway) India is honestly incredible. I worked with/on the tech when it was very nascent in 2016 and in 2022, on visiting India after a long time I was stunned to see _everyone_ has a lit
19.
by hackpert 4y ago
That is actually pretty freaking cool. Not hard to do by any means, just cool.
20.
by hackpert 4y ago
x2go works quite well actually. Its definitely not like local but it does the job.
21.
by hackpert 4y ago
A similar thing happened to me and my partner in the US, in a fairly liberal part, so I'm not entirely surprised that it's happening in SEA. People wouldn't rent to us because we told them we cook at home and these white folk
22.
by hackpert 4y ago
Honestly! This is such a good initiative that it bothers me that this is flagged. Housing issues for queer people is one the biggest issues across the world. I mean the first things we consider before even booking a hotel across most of the
23.
by hackpert 5y ago
Ooh good recommendation, lobste.rs is cool. I've been looking for someone with a potential invite for a while too if anyone here is offering :).
24.
by hackpert 5y ago
About the bit regarding you possibly commuting from Paris to London for work, I'm curious - how would that even work? Would you go through customs every morning/evening? Has anyone here done this?
25.
by hackpert 5y ago
*her mentor :) Source: https://ewintang.com/
26.
by hackpert 6y ago
Yes yes yes please somebody look into latency with these fancy ML methods! You can quite literally have most ML models approximated to a very good degree as very fast DSP using very few processor cycles given modern-day CPU optimizations. O
27.
by hackpert 6y ago
Last month, I was working with some people on building a decentralized health data store for vaccine waitlists (a la Mailbox) and certificates and we were looking at Solid as one potential backbone. I really admire what they’re trying to do
28.
by hackpert 6y ago
While this certainly seems to be redefining ASD as other commenters seem to suggest and we can debate if that is a good thing or not, it seems like it would be relatively straightforward to test the validity of this theory (perhaps not easy
29.
by hackpert 6y ago
I disagree heavily. The focus of this conversation seems misdirected, whether intentionally or not. It’s not about the fragility of morality as a system at all, which it of course is because it’s based on consensus. It’s about fundamental p
30.
by hackpert 6y ago
Honestly I just sometimes want a clamp with a flexible sturdy arm, like one of those workbench lamps, to suspend my laptop above my bed. Pretty cool work nonetheless!

More ›