rryan

5 ms·

1.
by rryan 1mo ago
CircleMUD was my first intro to C and network programming. I was at a computer camp for 8-10 year olds that taught BASIC. One of the counsellors was doing their undergrad at caltech and pulled the students who were bored by BASIC into a sep
2.
by rryan 1mo ago
Heh, not really
3.
by rryan 1mo ago
Disagree. The abstractions they are talking about aren't like, the y-combinator. They're talking about boring software engineering abstractions.
4.
by rryan 1mo ago
I know nothing about the PhD candidate and professor who co-authored this, but I don't think this statement makes sense in general. Typically CS labs at universities contain people who have not spent a significant amount of time expose
5.
by rryan 1mo ago
agents are unlike humans in many ways but they have their own limitations. it's magical thinking to believe that they are able to cope with zero software abstractions, especially as a codebase increases in size and complexity and today
6.
by rryan 1mo ago
No longer the case
7.
by rryan 2mo ago
ehh, no? definitely not. https://kyutai.org/blog/2024-07-03-meet-moshi/
8.
by rryan 5mo ago
As a human emdash enjoyer, I'm pretty damn grumpy that everyone assumes I'm a chatbot now. :P
9.
by rryan 5mo ago
I think the super long timelines in automotive make it really hard to succeed. Really impressed with what ClearMotion accomplished given that
10.
Moving fast in hardware: lessons from lab to $100M ARR(blog.zacka.io)
116 points by rryan 5mo ago|26 comments
11.
by rryan 1y ago
Don't make me tap the sign: There is no such thing as "bytes". There are only encodings. UTF-8 is the encoding most people are using when they talk about modeling "raw bytes" of text. UTF-8 is just a shitty (biased)
12.
by rryan 2y ago
RMSNorm is pretty insigificant in terms of the overall compute in a transformer though -- usually the reduction work can be fused with earlier or later operations.
13.
by rryan 2y ago
ML 101: Do not evaluate on the training data. Yes of course it can, because they fit in the context window. But this is an awful test of the model's capabilities because it was certainly trained on these books and websites talking abou
14.
by rryan 3y ago
Thanks for everything, Rich. You inspired me repeatedly.
15.
by rryan 3y ago
https://elevenlabs.io/ https://twelvelabs.io/ .... wat
16.
by rryan 3y ago
Yea uh, don't know what was going on there but there are roles with direct reports that aren't in mountain view (unless you mean, like in 2004). NYC has 1000s of googlers.
17.
by rryan 3y ago
This is ... not what I expected. It's basically wiring up pre-trained models to ChatGPT via a router and "modality transformations" (a.k.a speech-to-text and text-to-speech). I expected it to be a GPT-style model that process
18.
by rryan 4y ago
Except when your doctor won't prescribe it you offlabel because you don't have a condition they were taught about in med school
19.
by rryan 4y ago
In the past few months I've been getting much more fake order / payment spam.
20.
by rryan 4y ago
I agree that a Transformer is an example of a "reflexive" behavior because it learns to react in a context (via gradient descent rather than evolution as the learning algorithm). It's a conditional categorical distribution on
21.
by rryan 4y ago
There's a huge difference between fitting a probabilistic model to a data distribution then sampling from it (what GPT-3 is) and agents that invent language and use it to communicate.
22.
by rryan 4y ago
You're using a pointwise loss, which means you are treating each timepoint as conditionally independent. That's a deeply flawed assumption, probabilistically. Try an autoregressive model of the joint probability distribution of th
23.
by rryan 4y ago
"I could go pro, but nah" -- I read this and closed the tab. What a whingefest from a free tier user. The Reddit crawling problem is because Reddit rate limits their crawling so they have to prioritize the most popular feeds. What
24.
by rryan 4y ago
That makes no sense. Why is "YouTube Premium" capitalized?
25.
by rryan 4y ago
> The main source of income for youtube isn't ads. YouTube revolves around the merchandise and YouTube Premium subscriptions. > If you are talking about creators who are not earning money for using vanced, you should know they wo
26.
by rryan 5y ago
N=20
27.
by rryan 5y ago
* YouTube Kids with allowlist. * App Timer of zero minutes on YouTube app.
28.
by rryan 5y ago
Straw man argument. OP was suggesting you pay for YT premium, which does away with the ads completely. Removing your web adblocker is a non sequitur, and exposes your computer to malware / spyware in addition to ads.
29.
by rryan 5y ago
Parents are treated equally. If you give birth you get an additional 6 weeks of medical recovery leave . If two parents (any gender) adopt a child then both receive an equal length baby bonding leave . I've taken parental leave twice
30.
by rryan 5y ago
nit: Kubernetes is the container orchestration, not the container technology itself. So the comparison is apples vs. oranges. You could replace the containers that are being scheduled by Kubernetes with WebAssembly. Others already linked to

More ›