the8472

5 ms·

1.
by the8472 4d ago
I don't think their primary intent is to create a surveillance state (though google might like having yet another data source...), I think companies are trying to make it happen to capture transportation market share, regulators will w
2.
by the8472 4d ago
I don't think crypto is comparable. They barely made some dedicated crypto GPUs that market was always fickle due to ASCIs. Look at the nvidia revenue breakdown chart, the AI boom looks quite different. https://ourworldindat
3.
by the8472 4d ago
No, the argument should be raised before that happens. You want to prevent undesirable things from happening, not try to claw them back after they happened. It looks quite foolish to me to never plan ahead and predict undesirable future eve
4.
by the8472 4d ago
Look at the techempower benchmarks, even python stuff can handle 40k requests per second involving database lookups, and when things are cachable compiled/JITed languages scale to millions on 2 CPUs. And if you object that those are mi
5.
by the8472 4d ago
But it's a reduction of privacy compared to private vehicles. If the goal is to convert all transportation infrastructure into surveilled transportation then that is a loss in privacy for the general public.
6.
by the8472 9d ago
Defender LLMs without human in the loop are just another prompt injection (AI phishing) and DoS attack vector. Any meaningful mitigation capability you give them is also a capability to do damage. If they can only deploy package updates tha
7.
by the8472 9d ago
There is a certain irony blaming the autotype rather than the lack of review...
8.
by the8472 9d ago
I have never seen a person walk up to a billboard and click it.
9.
by the8472 10d ago
Not really a side-channel, but remember stuxnet? Airgapped networks are rarely truly isolated, you still have to get data in and out every now and then, in principle after careful vetting. But the AI could manipulate the files that are carr
10.
by the8472 12d ago
I am not seeing MIRI prioritizing capabilities over safety/alignment research.
11.
by the8472 13d ago
It's not reasonable because the error bars of each estimate compound and they may not even be normally distributed in the first place. You should rather convolve probability distributions - assuming factors are independent - and if the
12.
by the8472 17d ago
> 2. Only a small fraction of AI agents was engaged in this attack. Look at the chart at page 8 of the report, by Jul 12 the vast majority of the bots used the board and participated in the attack
13.
by the8472 17d ago
Only a few countries would be enough, the rest will get banned until they pass apply similar policies.
14.
by the8472 17d ago
Though that friction is paid in human lifespan, unlike a deposit fee that cannot be recovered if your request is found have merit. Additionally the other side often is not incentivized to minimize the friction. So ideally these processes wo
15.
by the8472 19d ago
... or those who don't know about constant-time functions, the difference between sha1 and argon2, etc. etc. I had to fix such things several times in corporate internet-facing systems. A generalist engineer can do this just fine, if t
16.
by the8472 21d ago
This is a common trope in such scenarios that the author has to pull their punches. Everyone acts locally-reasonable and still ends up losing. If you let people lose due to stupid mistakes then readers go "this is stupid, I wouldn&#x2
17.
by the8472 21d ago
As long as you give the AI any IO that is an exploit channel. E.g. it could manipulate its human handlers. This known as the AI Boxing problem. And if you give it no IO at all then it is useless. And the AI labs aren't currently displa
18.
by the8472 21d ago
It does not stop at negotiation power, if your economic value is epsilon above zero, what do you have to offer to exchange for food calories? I'm already seeing things being assessed on a Joules/Token basis.
19.
by the8472 26d ago
> 3 of the most common functionalities. Four. Though you initially asked for five features, so let me add lexopt, which brings the number up to 29. > That's why projects end up with 100s of crates, sometimes 1000s. If your argum
20.
by the8472 27d ago
Rust releases a new version every 6 weeks and the latest version is the only supported version. This is only tenable when the amount of breaking changes is tiny and each instance's impact is analyzed and cost-benefit tradeoff is checke
21.
by the8472 27d ago
Ok, so I created an empty cargo project and added serde_json, regex, walkdir and rand. This added 28 crates, several of these from the same authors. If the absence of these features caused 1000s of dependencies, then where are the remaining
22.
by the8472 1mo ago
Firefox doesn't decode the image into a full-resolution buffer and then downscale either, instead it does a streaming decode and applies downscaling on the fly. They call it downscale-during-decode[0]. I guess it doesn't do partia
23.
by the8472 1mo ago
I'm saying that with some costly adaptions that don't involve AI it's likely manageable for some time. Not that it will remain manageable forever if we do nothing. > You're looking at where the ball is and not where i
24.
by the8472 1mo ago
The point is to reduce the attack surface and blast radius and to slow it down. AIs aren't instant magic. Even the OpenAI swarm needed days for its compromises. And each needs lots of compute while targets are diverse, so it's not
25.
by the8472 1mo ago
There are other options. More air-gapping (especially backups) and compartmentalization, less internet. Hire more security engineers and put one in every team (actual security, not the compliance guys). Also more onprem work, less remote, l
26.
by the8472 1mo ago
> But the more interesting thing is Taken together these two things are even worse. They have unaligned AIs that may benefit an attacker and are proposing to deploy more AIs on the defenders side. What could possibly go wrong? For exam
27.
by the8472 1mo ago
A interesting talk, interesting times. But their proposed solution to AI offense outpacing human defense... is more AI? The plot is getting a bit unrealistic, the characters are lacking genre-savviness.
28.
by the8472 2mo ago
Just like Clippy https://gwern.net/fiction/clippy
29.
by the8472 2mo ago
Please fill out this form to verify you're human: https://litter.catbox.moe/3ugm2b0m1divdgxs.jpg
30.
by the8472 2mo ago
Yeah that's pretty much what gwern argues here[0]. Or to adapt another proverb: to predict the next token you first need to model the universe. [0] https://gwern.net/scaling-hypothesis#gwern-difference--effic...

More ›