glomgril

4 ms·

1.
by glomgril 1y ago
one man's exfiltration is another man's distillation `¯\_(ツ)_/¯` you could say they're playing by a different set of rules, but distilling from the best available model is the current meta across the industry. only they
2.
by glomgril 1y ago
Check out this recent benchmark MTOB (Machine Translation from One Book) -- relevant to your comment, though the book does have parallel passages so not exactly what you have in mind: https://arxiv.org/pdf/2309.16575 I
3.
by glomgril 2y ago
Very cool. Got a silly sci-fi question for you. IIUC, with current technology it would take on the order of tens of thousands of years for a vessel to physically travel to the closest known Earth-like planet (correct me if I'm wrong).
4.
by glomgril 2y ago
looks like it's there now
5.
by glomgril 2y ago
Models like this are experimentally pretrained or tuned hundreds of times over many months to optimize the datamix, hyperparams, architecture, etc. When they say "ran parallel trainings" they are probably referring to parity tests
6.
by glomgril 2y ago
He is coming from the perspective of a long-running debate on symbolic versus statistical/data-driven approaches to modeling language structure and use. It seems in recent years he has had trouble coming to terms with the fact that at
7.
by glomgril 3y ago
Savor it while you can. As a former academic, for me the lack of intrinsic motivation to "create value for shareholders" is the hardest part of working in industry.
8.
by glomgril 3y ago
As painful as it can be at times, it is a truly beautiful phase of life during which your main obligations are to become an expert in something that interests you and to make enough money to not starve and have a place to live. If you are s
9.
by glomgril 3y ago
This is just brilliant. Brings back memories, some fond others less so. Only addition I'd suggest is a subplot involving teaching/TAing duties and/or money problems. Good to be occasionally reminded that slacking off is a leg
10.
by glomgril 3y ago
That's an insane story. As much as I hate flying, modern aviation infrastructure is one of mankind's most impressive feats.
11.
by glomgril 3y ago
For those interested, there is a podcast about this book and some cases it's been relevant in: https://podcasts.apple.com/us/podcast/hit-man/id1449636432
12.
by glomgril 4y ago
Yeah that is consistent with my experience for sure. Probably true for lots of others too. I'm pretty neurotic about dumb shit on a day-to-day basis, but the few times something actually extremely serious has gone wrong in/around
13.
by glomgril 4y ago
That's kinda how the pandemic felt to a degree. A happier than average time in my personal life, despite (or perhaps due in part to?!) all the carnage and pandemonium throughout the world. Feels wrong to say, but I will look back on my
14.
by glomgril 4y ago
Big shouts to visidata -- very underrated tool imo.
15.
by glomgril 4y ago
The consistency of descriptions is particularly surprising to me. Like you got a roughly circular collection of seemingly random scribbles, but they can tell you exactly which parts of it correspond to the person's nose, hair, arms, ey
16.
by glomgril 4y ago
I have a very similar plan involving a Raspberry Pi, I agree that it's a great middle ground. IMO screentime that only involves video calls with family is perfectly fine, especially if it is a group activity. In general (timeboxed) soc
17.
by glomgril 4y ago
Is migrating domains from Gandi to somewhere else easy/possible? I've had the same domain for years, I used to pay like $20 for five years, but then I forgot to renew, and because I let it expire for a few days, now they are charg
18.
by glomgril 4y ago
Incredible post. I laughed when I saw the title, snickered at the first paragraph, and then proceeded to be blown away by the rest of it. Thought I was in for a joke and instead I'm thinking about the nature of ML Ops and what it'
19.
by glomgril 4y ago
Training code won't get you much if you don't have the infra/money to gather a suitable dataset or actually execute training. Plus if your goal is to "steal" or riff on the base model, it's already there in the
20.
by glomgril 4y ago
Hopefully so, would really like to know what else is lost by nerfing potentially offensive responses. Can't imagine a project I'd rather work on. I think open-assistant.io has a chance to do exactly this. We'll see what kind
21.
by glomgril 4y ago
This is the best advice on the topic that I've seen.
22.
by glomgril 4y ago
Yeah I think iPhone is a very apt analogy: certainly not the first product of its kind, but definitely the first wildly successful one, and definitely the one people will point to as the beginning of the smartphone era. I suspect we'll
23.
by glomgril 4y ago
I'm shocked that I've never heard this argument before. Very interesting and indeed, disturbing as well.
24.
by glomgril 4y ago
Yeah this is pretty much my line of thinking. Not making any grand claims, just questioning the conventional wisdom. No doubt that the material conditions, health, and conveniences of today are unparalleled in history, that's just not
25.
by glomgril 4y ago
Yeah that's pretty much where I end up: what it means to "thrive" is subjective and there's just not really a matter of the fact about what lifestyle is "best" for humans. Nevertheless, there are some scenarios
26.
by glomgril 4y ago
Right -- medical advances are the major exception to this line of thinking, as I noted.
27.
by glomgril 4y ago
Limitations and methodological questions about OP aside, I really question whether our modern lifestyle and all the technologies that enable it have led to increased human thriving. Medical advances have obviously been huge in making life l
28.
by glomgril 4y ago
If you're at Amazon you'll walk away with 5% after one year, and only 20% after two years.
29.
by glomgril 4y ago
Interesting perspective, agreed on some of the points. I'd like to hear some opinions from people who have worked as both "an engineer" and "a software engineer" (maybe OP is such a person, idk) -- what kind of corn
30.
by glomgril 4y ago
'corpora' fyi

More ›