rakejake

7 ms·

1.
by rakejake 8d ago
Plausible deniability - The line of attack is in their sessions/prompts data. Just make the prompt pointed enough that the search space is tractable and use your ginormous compute. > "Of course we don’t know whether that is tru
2.
by rakejake 8d ago
Yeah, I think you can't just throw money randomly at problems and expect results unless you know a line of attack that can get you all the way. OpenAI chose the line of attack only after it became known to them via rumors. They "f
3.
by rakejake 8d ago
Exactly! This is the real Occam's Razor explanation.
4.
by rakejake 8d ago
Are you saying there is no search space intractable to LLMs? That wouldn't be possible. AIs are statistical pattern-matchers on steroids. The prompt is key to getting anything useful out of them. They are incredibly useful and major ga
5.
by rakejake 8d ago
OAI started working on this only after they found out it was close to being solved. They threw a team of researchers who spent sleepless nights + a ton of compute. This is not exactly healthy academic competition - it's like if you spe
6.
by rakejake 8d ago
OAI doesn't need to mention Buckmaster's name directly in a prompt. They just need to select a basket of sessions that is guaranteed to contain Buckmaster's and then direct the LLM to attack only a specific method/angle.
7.
by rakejake 8d ago
I'd think nothing is "safe". Anything you say can and will be used by the LLM if it has enough statistical similarity to the prompt. Call it "Ma Random Rights"
8.
by rakejake 8d ago
Research equivalent of front-running.
9.
by rakejake 8d ago
I don't think OAI should be given the benefit of doubt. They are doing the research equivalent of front-running. Knowing where to look is one of the main challenges in research. Tristan's argument from his essay was that it is har
10.
by rakejake 17d ago
Try to increase the complexity of the work you're doing. It's not that AIs don't makes mistakes but they are able to pattern match to larger and larger pieces of the problem as more people use it and more iterations of the mo
11.
by rakejake 5mo ago
Yes, that does track with my personal experience. More context, more params and no quantization is probably it. But my hunch is that all the training data they've been getting in the past year also plays a part here. More than any othe
12.
by rakejake 5mo ago
>>> the model is (obviously) good at security Out of curiosity, are you one of the people who has access to the model? If yes, could you write about your experimental setup in more detail?
13.
by rakejake 5mo ago
Sure, I am not precluding the possibility that they've trained a genuinely great model. All I am saying is that the "this model better than that model" is moot when on one side you have model weights, and on the other side a
14.
by rakejake 5mo ago
>> Test it yourself, GPT 120B OSS is cheap and available. BTW, this is why with this bug, the stronger the model you pick (but not enough to discover the true bug), the less likely it is it will claim there is a bug. I guess this is t
15.
by rakejake 5mo ago
Maybe they did use small models but you couldn't make the front page of HN with something like this until Anthropic made a big fuss out of it. Or perhaps it is just a question of compute. Not everyone has 20k$ or the GPU arsenal to tas
16.
by rakejake 6mo ago
The word "profound" is a bit overused when it comes to movies. I agree that The Battle of Algiers is an excellent film, one of the best ever made even. One Battle After Another is also excellent but it is not really political in t
17.
by rakejake 6mo ago
Yeah, I'm watching a lot of Charlie Chaplin movies in preparation for my new role as a tramp.
18.
by rakejake 6mo ago
I agree on principle. But there is going to be a painful transition where people are still reckoning with the new capabilities so I understand where all the fear/sadness is coming from. Tbf I think the golden days of being a software d
19.
by rakejake 6mo ago
> I don't know if the market will have fully internalized that knowledge soon enough This exactly. I am neither a boomer nor a doomer. It has helped a lot both at work and in accelerating my personal projects. But now that the C-sui
20.
by rakejake 7mo ago
This started decently enough and then the author went all over the place. I'm not sure why detailed explanations of neural nets and smart contracts were needed here. It really feels like trying to ram in a tech solution for what is eff
21.
by rakejake 9mo ago
Excellent comment that really gets to the crux of the matter. Countries like China and India see themselves as civilizational, America sees itself as a perfect marketplace - it exists to feed its customers's wants and whims as efficien
22.
by rakejake 10mo ago
Rather than think of it as a pivot to hardware, I looked at it as MS trying to corner their share in the consumer market. Mobile and Social were the hot things back then and mobile threatened MS's dominance of the OS market. MS ultimat
23.
by rakejake 10mo ago
Ballmer doesn't strike me as an idiot and definitely not bland. He's one of the more colorful tech personalities. MS's almost unassailable lead in enterprise could be attributed to him and the pivot to cloud could not have ha
24.
by rakejake 10mo ago
My point was more that MS hasn't had an industry changing product in a while. Google became joint-SOTA in AI and seems poised to take the crown with the next Gemini, and also in self-driving cars and quantum computing. They've kep
25.
by rakejake 10mo ago
I often wonder why Satya Nadella is so venerated on HN compared to say, Cook or Pichai. As innovators, MS lags way behind both Google and Apple. I can't think of one bleeding edge product released during Satya's tenure. Say what y
26.
by rakejake 11mo ago
I guess Atlas is a good name for a web browser. But I'm surprised their first release is Mac only. Does it indicate they are targeting some kind of power user (programmers, creatives etc) or is it just the first platform they could shi
27.
by rakejake 1y ago
Unless the filmmaker has a track record of misrepresentation or negative representation, I tend to give them the benefit of the doubt. In any case, if the movie irked you that much, I don't think there's anything I can say to chan
28.
by rakejake 1y ago
Well there are no "good" characters in this film so how would one add a positive portrayal of blacks? Maybe "Pat" could have also been black but he's an ex-bomber turned paranoid junkie. I think the character traits
29.
by rakejake 1y ago
The review does not mention Deandra (played by Regina Hall) at all, among other black characters who weren't negative representations per se. Deandra is very prominent in the second act of the movie and her responsibility and dedicatio
30.
by rakejake 1y ago
Reviews are very hit or miss nowadays (mostly miss for me), but the verdict for One Battle After Another is absolutely correct. For those of you who are on the fence wrt watching this movie, the politics and the revolutionaries simply form

More ›