gchadwick

7 ms·

1.
by gchadwick 7d ago
> It baffles me that anyone still uses Mercator projection for any serious purpose. Tell me you've never done any serious navigation off a map or chart without telling me...
2.
Chips Startup Fractile Raises $220M to Speed Up AI Queries(wsj.com)
1 points by gchadwick 4mo ago|0 comments
3.
by gchadwick 5mo ago
I really enjoyed the book. Great for people who want to understand the real nuts and bolts and have worked examples of all of the calculations.
4.
by gchadwick 5mo ago
That's the beauty of side projects, you get to decide and you don't have to care about working with others. Really yearning for crafted code that meets every one of your perfect coding style guide and preference with green checks
5.
by gchadwick 5mo ago
On your side-project it's also ok to ignore best engineering practice, reinvent the wheel because you feel like it or make decisions based on what seems most interesting even if it's not a 'good' decision. The critical t
6.
by gchadwick 5mo ago
Remember OpenAI decided GPT 2 was far too dangerous to unleash upon the world when they first trained it!
7.
by gchadwick 6mo ago
A nice game, though the truth table lighting round is pretty punishing! Big contrast to the circuit building part where you can take your time. Personally I'd drop the time requirements from that quiz section.
8.
Nvidia Groq 3 LPX(nvidia.com)
4 points by gchadwick 6mo ago|0 comments
9.
by gchadwick 7mo ago
> Also we found the formal waiver analysis tools to be very effective for waiving unreachable code, in case you aren't using those. Yes we had used them just never got it slickly integrated into the verification dashboard. We had us
10.
by gchadwick 7mo ago
You can see the latest nightly results here: https://opentitan.org/dashboard/index.html note there are some 100% figures. Having spent several years working on OT I can tell you that most of the gaps are things that sh
11.
by gchadwick 7mo ago
I worked on OpenTitan for around 5 years at lowRISC. It certainly has its ups and downs but it's generated some great stuff and I'm very glad to see hit proper volume production like this. Whilst there's definitely open sourc
12.
by gchadwick 7mo ago
This is an interesting piece of hardware though when they go multi-chip for larger models the speed will no doubt suffer. They'll also be severely limited on context length as it needs to sit in SRAM. Looks like the current one tops ou
13.
by gchadwick 7mo ago
> If copying user tokens was the bottle neck, batching would not achieve any speed up. Reality is more complex. As context length grows your KV cache becomes large and will begin to dominate your total FLOPs (and hence bytes loaded). The
14.
by gchadwick 7mo ago
Anyone else find reading things like this slightly exhausting? I'm very much pro AI for coding there are clearly significant capabilities there but I'm still getting my head around how to best utilise it. Posts like these make it
15.
by gchadwick 7mo ago
Only taken a quick skim but this looks like solid material! RISC-V Vector is definitely tricky to get a handle on, especially if you just read the architecture documentation (which is to be expected really, good specification for an archite
16.
by gchadwick 8mo ago
A shame this hasn't shot to number 1 on HN and stayed there. At least it's getting reasonable upvotes. This is a truly fantastic piece of hacking, going by the original meaning of the word as used within the dawn of the computer e
17.
by gchadwick 9mo ago
Another example of the growing trend of buying out key parts of a company to avoid any actual acquisition? I wonder if equity holding employees get anything from the deal or indeed if all the investors will be seeing a return from this?
18.
by gchadwick 9mo ago
> However, Groq’s architecture relies on SRAM (Static RAM). Since SRAM is typically built in logic fabs (like TSMC) alongside the processors themselves, it theoretically shouldn't face the same supply chain crunch as HBM. It's
19.
by gchadwick 11mo ago
It's for a CS course at Stanford not a PyTorch boot camp. It seems reasonable to expect some level of academic rigour and need to learn and demonstrate understanding of the fundamentals. If researchers aren't learning the fundamen
20.
by gchadwick 11mo ago
Karpathy's contribution to teaching around deep learning is just immense. He's got a mountain of fantastic material from short articles like this, longer writing like https://karpathy.github.io/2015/05/21
21.
by gchadwick 1y ago
To me at least "not good after all" means their current latest hardware has issues which means it cannot replace Nvidia GPUs yet. This is a hard problem so not getting there yet doesn't imply bad engineering just a reflection
22.
by gchadwick 1y ago
I'd say there's a mix of 'Chinese GPUs are not that good after all' and 'Nvidia doesn't have any magical secret sauce, and China could easily catch up' going on. Nvidia GPUs are indeed remarkable devices w
23.
New Prefill Specialised GPU – Nvidia Rubin CPX(semianalysis.com)
5 points by gchadwick 1y ago|0 comments
24.
by gchadwick 1y ago
If I'm reading this right, glitching the I2C bus prevents the Secure Enclave from booting. It seems the device recovers from this itself 'Although the device recovered and remained operable', maybe the Secure Enclave reboots
25.
by gchadwick 1y ago
I thought it was a great book, dives into all the details and lays it out step by step with some nice examples. Obviously it's a pretty basic architecture and very simplistic training but I found it gave me the grounding to then unders
26.
by gchadwick 1y ago
The CTO of applications reporting to CEO of applications (who reports to the actual CEO) is kinda weird? I figure you're either the actual CTO or you're not a C-level exec and should have another title. Just more title inflation I
27.
by gchadwick 1y ago
Andes (Condor is owned by Andes) seems to get relatively little press Vs other RISCV outfits. My sense is they've been quietly building a very solid RISCV CPU business with a great IP portfolio. This latest core looks very interesting,
28.
by gchadwick 1y ago
Who knows what the closed source models use but certainly going by what's happening in open models all the big changes and corresponding gains in capability are in training techniques not model architecture. Things like GQA and MLA as
29.
by gchadwick 1y ago
Whilst it's maybe not worth studying them in detail I'd say being aware of their existence and roughly how they work is still useful. Seeing the many varied ways people have done things with neural networks can be useful inspirati
30.
by gchadwick 1y ago
If either of those accidentally triggered in the air would anything catostrophic happen? Auto breaks I guess have no effect in the air as they break the wheels? Thrust reverse unlock sounds like it allows thrust reversers but the pilot woul

More ›