benjismith

8 ms·

1.
by benjismith 27d ago
Knowledge cannot be "stolen"
2.
by benjismith 27d ago
I think this is just another part of the growing pains of working with machine intelligence that we have to endure. Much like we previously had to cope with "hallucinations" as an issue. If the ultimate goal of AI is to develop ge
3.
by benjismith 29d ago
Ahhh okay. They've definitely had some growing pains. By "fall from grace", I assumed you meant some sort of ethical/trust failure.
4.
by benjismith 29d ago
What do you mean by "Github's fall from grace"? What happened?
5.
by benjismith 1mo ago
I've been using the classic word2vec implementation for many years to produce text embeddings for a variety of workloads. It was written by Tomas Mikolov at Google in 2013 and written in C: https://code.google.com/archi
6.
Fast Mojo implementation of classic Word2Vec algorithm(github.com)
2 points by benjismith 1mo ago|1 comments
7.
Show HN: Duiduidui is a new Chinese dictionary and flashcard app(duiduidui.app)
2 points by benjismith 2mo ago|0 comments
8.
by benjismith 3mo ago
It's been a while (15+ years) since I was in that game... but back then, it was $60k for a Phase I and $200k for a Phase II. Phase III and beyond was open-ended. You don't really make money on Phase I projects, but that's how
9.
by benjismith 3mo ago
I used to work for a company (~50 people) whose entire business was based on the SBIR pipeline. We did a lot of super-interesting work! Here's my advice: 1) Your proposal needs to be completely solid and well-structured: - Describe the
10.
by benjismith 3mo ago
It makes perfect sense. Apple's philosophy is that new APIs need some time to stabilize before they can be baked-in as a commitment to third-party developers. So new APIs are almost always first-party only. Apple designs the API and be
11.
by benjismith 5mo ago
I thought this pull-quote was interesting: "Interoperability only works when it is built into the platform from the start" -- Lucas Lasota, FSFE Legal Programme Manager To my mind, this is almost exactly opposite of true. Most new
12.
by benjismith 5mo ago
This is true, but I also think the input context isn't the only function of those tokens... As those tokens flow through the QKV transforms, on 96 consecutive layers, they become the canvas where all the activations happen. Even in cas
13.
Your Brain Is a Ball of Electric Spaghetti(machinecreativity.substack.com)
2 points by benjismith 6mo ago|0 comments
14.
by benjismith 7mo ago
Product Engineer (full stack, design + ux) Former Founder / Principal Engineer of https://shaxpir.com Location: Portland, OR Remote: Yes Willing to Relocate: Yes Technologies: Java, AWS, TypeScript, Elasticsearch, Realtime
15.
I asked Claude for 37,500 random names, and it can't stop saying Marcus(github.com)
91 points by benjismith 7mo ago|72 comments
16.
Benji's Guide to Machine Creativity(machinecreativity.substack.com)
1 points by benjismith 7mo ago|0 comments
17.
by benjismith 9mo ago
> show LoRA on a 400B model, or full fine-tuning on a 70B Yeah, that's what I wanted to see too.
18.
by benjismith 9mo ago
I think the biggest injury to the hiring of junior devs happened after COVID made remote-work ubiquitous. It's a lot harder for a junior dev to get real mentorship, including the ambient kind of mentorship-by-osmosis, when everyone wor
19.
by benjismith 1y ago
I read it. I also searched the page for the word "Opus" and it didn't appear anywhere. The word "Sonnet" appears, but only once. There's also "GPT-4.1 or GPT-5", but that's not what my question i
20.
by benjismith 1y ago
Sonnet only?
21.
by benjismith 1y ago
A similar kind of question about "understanding" is asking whether a house cat understands the physics of leaping up onto a countertop. When you see the cat preparing to jump, it take a moment and gazes upward to its target. Then
22.
by benjismith 1y ago
Same for me :)
23.
by benjismith 1y ago
Is there way to get "speech marks" alongside the generated audio? FYI, Speech marks provide millisecond timestamp for each word in a generated audio file/stream (and a start/end index into your original source string), a
24.
by benjismith 1y ago
If I'm reading the pricing correctly, these models are SIGNIFICANTLY cheaper than ElevenLabs. https://platform.openai.com/docs/pricing If these are the "gpt-4o-mini-tts" models, and if the pricing estima
25.
Show HN: Hypnotizing ChatGPT(chatgpt.com)
2 points by benjismith 2y ago|0 comments
26.
by benjismith 2y ago
Nope. They needed the maximum amount of thrust from those boosters in order to propel the spacecraft toward Jupiter, so they couldn't save enough fuel for the boosters to land themselves. This was the 6th flight of these boosters, so w
27.
by benjismith 2y ago
Awesome, I'm been following Seph's work for many years! Always thoughtful and well-executed. Probably the most prolific and insightful engineer in the "collaborative text editing" universe. I use ShareDB every day, which
28.
by benjismith 2y ago
It doesn't sound like they "failed" any actual safety test, but rather that they rushed their safety tests, thereby "failing" (in the eyes of many people) to conduct sufficiently rigorous tests. Now that the 4o mode
29.
by benjismith 3y ago
Nice! Thank you for the links!
30.
by benjismith 3y ago
This reminds me of the amazing molecular animations of Drew Berry, which he showed in this TED talk: https://youtu.be/WFCvkkDSfIU?si=JNe06VS8TjIrHpqh Which was 12 years ago! After watching that video, I had a much greater a

More ›