billmalarky

5 ms·

1.
by billmalarky 2mo ago
>As does the economic picture that justified the massive infrastructure building that’s now broadly funded by a complex network of debt. I have a genuine question and I'd like to hear people's good faith thoughts on this. There
2.
by billmalarky 7mo ago
Yes -- definitely that's the value prop. But it's not binary all or nothing. AI automation is about trust (honestly, same as human delegation). You give it access to a little bit of data, just enough to do a basic useful thing or
3.
by billmalarky 7mo ago
Bastion hosts. You don't give it your "prod email", you give it a secondary email you created specifically for it. You don't give it your "prod Paypal", you create a secondary paypal (perhaps a paypal account r
4.
by billmalarky 8mo ago
Hi Kypro this is very interesting perspective. Can you reach out to me? I'd like to discuss what you're observing with you a bit in private as it relates heavily to a project I'm currently working on. My contact info is on my
5.
by billmalarky 1y ago
Ah, I probably should have listed some of the "assumptions" I'm developing it on top of: 1) Regarding the "generation is how learning occurs" claim, I'm going off of this: https://www.learningscienti
6.
by billmalarky 1y ago
Hi Swyx I always appreciate your insights, something you wrote really resonated with a personal theory I've been developing: >"While I never use AI for personal writing (because I have a strong belief in writing to think)"
7.
by billmalarky 1y ago
word ;)
8.
by billmalarky 1y ago
Search tool calling is RAG. Maybe we should call it a "RAG Agent" to be more en vogue heh. But RAG is not just similarity search on embeddings in vector DBs. RAG is any type of a retrieval + context injection step prior to inferen
9.
by billmalarky 1y ago
I built a distributed software engineering firm pre-covid, so all of our clients were onsite even though we were full-remote. My engineers plugged into the engineering teams of our clients, so it's not like we were building on the side
10.
by billmalarky 1y ago
I've been lucky enough to have a few conversations with Scott a month or so ago and he is doing some really compelling work around the AISDLC and creating a factory line approach to building software. Seriously folks, I recommend follo
11.
by billmalarky 1y ago
^ this guy knows Jobs To Be Done theory ;) For those who don't, reading "Competing Against Luck" by Clayton Christensen will dramatically improve your ability to create successful products/services.
12.
by billmalarky 2y ago
Yes. Absolutely it is. For different workloads it is an insanely effective tool.
13.
by billmalarky 2y ago
Hi Paul, been following the aider project for about a year now to develop an understanding of how to build SWE agents. I was at the AI Engineering Summit in NYC last week and met an (extremely senior) staff ai engineer doing somewhat unbeli
14.
by billmalarky 2y ago
Hey! this is exciting to see! Hi Earl and Oisin! (I've had the pleasure of meeting Earl and Oisin face to face a few times. Really friendly and smart guys, fwiw based on my convos they are very serious about building a compelling produ
15.
by billmalarky 2y ago
You find issues when they surface during your actual use case (and by "smoke testing" around your real-world use case). You can often "fix" issues in the base model with additional training (supervised fine-tuning, reinf
16.
by billmalarky 2y ago
This post is using regression to build a reward model. The reward model will then be used (in a future post) to build the overall RL system. Here's the relevant text from the article: >In this post we’ll discuss how to build a rewar
17.
LLM Fine-Tuning Best Practices: Base Models Proprietary/Open Source, Large/Small(openpipe.ai)
2 points by billmalarky 2y ago|1 comments
18.
by billmalarky 2y ago
Hey HN! I've been working on a series capturing the industry best practices in producing fine-tuned LLMs. Our first post covered training data preparation, and for this one we'll be talking about how to select your base model and
19.
LLM Fine-Tuning Best Practices for Training Data Curation(openpipe.ai)
1 points by billmalarky 2y ago|2 comments
20.
by billmalarky 2y ago
I recently interviewed Kyle Corbitt (YC23 Founder) who has been deeply involved in the LLM fine-tuning space the last couple years. Much like with pre-training models, most of the performance gains ultimately delivered from a fine-tuned mod
21.
by billmalarky 2y ago
Greatly appreciate the suggestion! but I recently joined another YC backed Gen AI startup in the fine-tuning space (OpenPipe) :-D Speaking of, there's a good chance fine tuned models will be a component of your fully-optimized codebase
22.
by billmalarky 2y ago
Do you build a syntax tree of the code, then loop the tree to auto-write an article for each node (or the larger or more material nodes) and then also reference the tree to pull in related nodes/pieces/modules/whatnot of the
23.
by billmalarky 2y ago
Can you share some basic insight into how your system processes an open source repo to generate a wiki with a hierarchy and structure that maps to the same or similar hierarchy and structure of the codebase? I can understand the value of ma
24.
by billmalarky 2y ago
Founding AI Engineer at OpenPipe here, using a fine tuned "router LLM" to route between various specialized (inc fine tuned but not necessarily) applied models depending on the input is becoming a common pattern in more modern &qu
25.
by billmalarky 2y ago
Hi Richard I just reached out to you on LI. I'd love to get a chance to chat with you about your experience with this. Thank you for sharing this is fascinating.
26.
by billmalarky 2y ago
Is there a way I can connect with you off HN? I'm a student of design/innovation though my background is in engineering. I'd love to be able to learn from you from time to time.
27.
by billmalarky 2y ago
>First, start with the M, not the P. Well said! This is basically the linchpin behind the Jobs to be Done theory commonly attributed to Clayton Christensen (many thought leaders developed the theory over the years which he credits, but C
28.
by billmalarky 3y ago
Fair, but I'd still like to learn from ya ;-) If I shoot you an email and you aren't interested, please just archive it. But if you're in the teaching mood I'd love to be your student for 30 min :D
29.
by billmalarky 3y ago
Hi Max, I'm unaffiliated w/ langchain, but happen to be friends w/ Harrison. He's a very genuine person who authentically desires continuous improvement of LC's tech. Would you be open to hopping on a call some time
30.
by billmalarky 4y ago
That's not a fair statement though. There is also the war in Europe, and the covid pandemic is not a solved problem, especially in China. There are many more serious factors than simply a rate increase, each of which alone could lead t

More ›