gebdev

8 ms·

1.
by gebdev 1mo ago
I’ve been thinking about this same idea recently, so I’m glad it exists now! The biggest benefit I see is to enable RAM constrained GPUs to perform inference of large parameter models with surprisingly high throughput. Because only a single
2.
The Thirty Million Line Problem (2019) [video](youtube.com)
1 points by gebdev 7mo ago|0 comments
3.
Improper Hierarchy (2018) [video](deconstructconf.com)
2 points by gebdev 9mo ago|0 comments
4.
by gebdev 9mo ago
Loved this article. It showed how lacking my knowledge is in how operating systems implement concurrency primitives. It motivated me to do a bunch of research and learn more. Notably the claim about how atomic operations clear the cache lin
5.
by gebdev 10mo ago
> My experience with arenas is that they increase performance at the cost of a little extra memory usage. ack, thanks! You’re exactly right, I got my words mixed up.
6.
Pathological PATH(gebdev.net)
5 points by gebdev 10mo ago|0 comments
7.
A Day at the Park (2013)(kiriakakis.net)
1 points by gebdev 10mo ago|0 comments
8.
by gebdev 10mo ago
This article is really well written. I like how it defines a new concept (bughouse chess), then uses it to help describe an emotion they’ve been feeling wrt more popular culture. I also think bughouse seems cool (aside from the issues menti
9.
by gebdev 10mo ago
This is a great example of how ADTs can be implemented in C by emulating classes, despite the loss in brevity. For the first item on reference counting, batched memory management is a possible alternative that still fits the C style. The u
10.
by gebdev 1y ago
While I tend towards the side of the article, I find it difficult to agree (or follow) many of the points it makes, which is a bit disappointing. For example, under “ChatGPT Is So Popular”, they disagree with the premise then use the argume
11.
by gebdev 1y ago
This is an interesting study. I wonder how the LLM option might compare to human written responses in the same format (but with higher latency), or even to having a physical human in the room. Given some of the points from the conclusion ab