smaddox

10 ms·

1.
by smaddox 1y ago
> though we did not delve into the observation Oh, the irony.
2.
by smaddox 1y ago
Gold/M2SL(Billion USD) is currently around 0.12. In 1980, it peaked around 0.45. Monthly average since 1960 is 0.11. In late 2011 it peaked around 0.18. Gold / Global M2 would be a better metric, but I haven't analyzed that y
3.
by smaddox 1y ago
I switched to Windsurf.ai when cursor broke for me. Seems about the same but less buggy. Haven't used it in the last couple weeks, though, so YMMV.
4.
by smaddox 1y ago
For those who are actually interested in this field, the proper way to measure this would be with a four point probe. You do need a constant current source and a high-impedence voltage meter, though. Also, you don't need to solder wire
5.
by smaddox 2y ago
You can train that size of a model on ~1 billion tokens in ~3 minutes on a rented 8xH100 80GB node (~$9/hr on Lambda Labs, RunPod io, etc.) using the NanoGPT speed run repo: https://github.com/KellerJordan/modded-n
6.
by smaddox 2y ago
> That application was submitted in March 2024 and is on track for approval in December 2026 Huh? Is this something where there's multiple incremental steps in the process, and that date is just the final approval stamp, or does it
7.
by smaddox 2y ago
Agree more levels seems like it could be beneficial. And another Meta paper published a day later shows how that might work: https://ai.meta.com/research/publications/large-concept-mode...
8.
by smaddox 2y ago
Oh, interesting. 120db is much better than what I thought possible with CMOS sensors. Thats competetive with the human eye. Well, that definitely changes my opinion on how feasible/competitive camera-only autonomous driving can be.
9.
by smaddox 2y ago
Apparently they're using this CMOS sensor: https://www.onsemi.com/products/sensors/image-sensors/ar0136... It's not an event camera, so it's very much taking images, which are then being proces
10.
by smaddox 2y ago
> if you compare Intel's headcount with comparable companies (AMD, Nvidia), you can see Intel is really wasteful AMD and NVIDIA are fabless. They are not comparable. It takes far more people to R&D a cutting-edge process node an
11.
by smaddox 2y ago
If both sides are frosted, then you will have a similar effect as subsurface scattering.
12.
by smaddox 2y ago
I've been using this for a few weeks now, and it's really handy. But I did learn the hard way that it fails if you don't have internet connection, even if you already have the venv cached.
13.
by smaddox 2y ago
Not the OP, and not at all an expert in this area, but I was curious what the answer was, and from a bit of reading it seems like a potential reason that might not work is because volatile also prevents caching the value in a register. So i
14.
by smaddox 2y ago
The slowdown is in the simulation, not in the internally perceived flow of time. The internally perceived flow of time would of course not change. The problem is that an exponential slowdown at each level requires discounting the probabilit
15.
by smaddox 2y ago
Photocopying has little to do with simulation of the physical world. First of all, Bits != Q-bits. You can clone bits. You can't clone Q-bits: https://en.m.wikipedia.org/wiki/No-cloning_theorem Second, photocopies
16.
by smaddox 2y ago
Exponential slowdowns at each level ruin this hypothesis.
17.
by smaddox 2y ago
If you think novels, especially good ones, are "stories of made-up people that aren't intended to illustrate any particular idea", then you're missing quite a bit.
18.
by smaddox 2y ago
This model of physics does make some falsifiable predictions, and there are discussions about how to test them elsewhere. Unlike string theory, this theory does not have any free variables to adjust. It's either true or it's false
19.
by smaddox 2y ago
I can understand how the "up to an annual contribution limit" part of my comment could be confusing. I added that in an attempt to not be misleading / to circumvent spurious disagreement. I've moved it inside of parenthe
20.
by smaddox 2y ago
False dichotomy. Prior to CU, individuals could contribute to any candidate of their choosing (up to an annual contribution limit). Companies are compased of individuals. CU was twisted logic to reach a preconceived, corrupt outcome.
21.
by smaddox 2y ago
Verified pre and post conditions would be nice. Especially in the era of LLM's, which can usually fill in the implementation given a sufficiently clear specification.
22.
by smaddox 2y ago
To clarify what the parent is getting at: Moore's law is an observation about the density (and, really about the cost) of transistors. So it's about the fabrication process, not about the logic design. Practically speaking, though
23.
by smaddox 2y ago
Probably using Go and defaulting to zero unix timestamp.
24.
by smaddox 2y ago
Except anyone can start a parallel chain, e.g. DogeCoin. The only thing that makes BitCoin special is that it was the first and is still the most well known. It's value is entirely based on network effects and speculation. It's a
25.
by smaddox 2y ago
No wonder I've seen such a major spike in spam calls / texts.
26.
by smaddox 2y ago
Because existing LLMs store no more than 2bits of knowledge per parameter, despite having many more bits of precision: https://arxiv.org/abs/2404.05405
27.
by smaddox 2y ago
> It seems that using OOP in Lua can quickly and surprisingly lead developers into a situation where adding new features becomes really hard. Not just in Lua...
28.
by smaddox 2y ago
Skimming MISRA C, it seems to be a collection of either extremely limiting or ineffectual directives. An example of each: > Dir 4.12 Dynamic memory allocation shall not be used > Rule 2.2 There shall be no dead code https:/&#x2F
29.
by smaddox 2y ago
The first two changes appear theoretically sound, but it's not clear that they would result in an actual performance improvement at scale. Their analysis ignores that a single matrix multiplication is typically used to calculate the Q,
30.
by smaddox 2y ago
4090 should have enough VRAM for 124M param training. Even at float32 precision, with AdamW optimizer, parameters should only be ~2GB (124M params x 4 bytes per param x ~4 for optimizer weight overhead). So there should be plenty of remaini

More ›