jbay808

5 ms·

1.
by jbay808 1mo ago
Yes, exactly. And it's the compression that makes this happen. If it was just curve-fitting then the LLM really would act like a stochastic parrot, and it wouldn't generalize; also the model would also need to be much much bigger.
2.
by jbay808 1mo ago
Imagine you're curve-fitting a bunch of data points on, say, the orbital motion of planets and asteroids. You get tons and tons of data on these orbital motions, and then put it into a huge black-box optimization algorithm that compres
3.
by jbay808 6mo ago
If the proof of concept takes an hour to code up, or proving the market exists just takes a bit of googling, then sure, you can prepare that before the first meeting where you suggest the idea. If the proof of concept requires spending a fe
4.
by jbay808 6mo ago
You must have very different kinds of meetings than I do. Unless you're going into that meeting with a rehearsed PowerPoint presentation, or there's a strict agenda that doesn't allow any time for exploration, I expect to hea
5.
by jbay808 6mo ago
You can fire the shot and then patch the hole at the same time, proposing solutions to the same problem you pointed out, rather than just shooting and letting one person handle defense from every attack.
6.
by jbay808 9mo ago
Definitely impressive as a proof of concept. A lot of the other problems can be solved with iteration. There are some IP67-rated drone motors meant to both fly and run underwater (available from Westmag for example). There might be less tha
7.
by jbay808 1y ago
You can do a lot with chaos. One of the things it lets you do is find an unforced trajectory from the vicinity of any state to the vicinity of any other (accessible) state. Sensitivity to initial conditions means sensitivity to perturbation
8.
by jbay808 1y ago
You have to account for the energy required to break the bonds of the CH4, though. This means if you burn methane the usual way you get (CH4 + 2O2 --> CO2 + 2H2O + 803 kJ/mol); if you burn it with an ideal zero-emissions reaction,
9.
by jbay808 1y ago
Interesting to see this on the HN front page. On the subject of methane pyrolysis, it turns out if you look at the Gibbs free energy calculation, about half of the energy of methane combustion is released from the formation of water, and th
10.
by jbay808 1y ago
It's mainly the laser itself that is the expensive part. If you only care about resolution it's easy, you just need a single-mode laser. But if you care about accuracy it's very difficult, because then the wavelength needs to
11.
by jbay808 1y ago
Thanks, it should be fixed now!
12.
by jbay808 1y ago
This one still keeps me up at night, especially the figure on the 6th page. https://web.archive.org/web/20180513182952/http://burro.case... The short summary of this hypothesis is that the ocean develops
13.
by jbay808 1y ago
I disagree with the assertion that "VLMs don't actually see - they rely on memorized knowledge instead of visual analysis". If that were really true, there's no way they would have scored as high as 17%. I think what thi
14.
by jbay808 1y ago
If I were given five seconds to glance at the picture of a lion and then asked if there was anything unusual about it, I doubt I would notice that it had a fifth leg. If I were asked to count the number of legs, I would notice right away of
15.
by jbay808 1y ago
This might be a great alternative to beryllium copper for the spring contact element in high-current electrical connectors.
16.
3D Print Anything Without Supports [video](youtube.com)
3 points by jbay808 1y ago|0 comments
17.
by jbay808 2y ago
Can you say more precisely what you mean?
18.
by jbay808 2y ago
I mean that needing to scan the full context of tokens before the nth is inherent to the problem of sorting. Transformers do scan that input, which is good; it's not surprising that they're up to the task. But pairwise numeral c
19.
by jbay808 2y ago
> I don’t really understand what you’re testing for? For this hypothesis: The intelligence illusion is in the mind of the user and not in the LLM itself. And yes, the notion was provided by the training data. It indeed had to learn t
20.
by jbay808 2y ago
It might seem like you could sort with just pairwise correlations, but on closer analysis, you cannot. Generating the next correct token requires correctly weighing the entire context window.
21.
by jbay808 2y ago
I was interested in this question so I trained NanoGPT from scratch to sort lists of random numbers. It didn't take long to succeed with arbitrary reliability, even given only an infinitesimal fraction of the space of random and sorted
22.
by jbay808 2y ago
Yes, this is how frequency-doubled lasers work (eg. 532 nm green laser pointers, which are generated as a harmonic from a 1064 nm Nd:YVO4 laser by a nonlinear KTP crystal).
23.
by jbay808 2y ago
That's a great question! I have no idea. At low frequencies it should be very easy, because the sound is just a pressure measurement, so you can compare against a calibrated pressure reference. So the main challenge is measuring the hi
24.
by jbay808 2y ago
This project might be exactly what you're looking for: https://github.com/peterdsharpe/AeroSandbox
25.
by jbay808 2y ago
This is correct, although in my experience the distribution is often more like a lognormal than a Gaussian: https://thesearesystems.substack.com/p/task-estimation-conqu...
26.
Telescoping Linear Actuator(mymechatronics.pbworks.com)
2 points by jbay808 2y ago|0 comments
27.
by jbay808 2y ago
I'd expect Chebyshev polynomials to be much faster and easier to work with than splines, certainly, and probably Fourier series as well. (Especially if there aren't trig instructions in hardware, because then each sine or cosine i
28.
Speedrunning 30 years of lithography technology [video](youtube.com)
2 points by jbay808 2y ago|0 comments
29.
Electromagnets for attracting copper and aluminum (1951) [pdf]
1 points by jbay808 2y ago|0 comments
30.
by jbay808 2y ago
One reason you can get away with this sometimes is that ADCs themselves act like a low-pass RC filter. The ADC input is itself a capacitor that gets charged to the voltage that needs to be measured, and it has an appreciable resistance (whi

More ›