lorey

7 ms·

1.
by lorey 8d ago
Had the same issue. In the end, getting pulled into some Google Ads sales funnel and them solving the issue through internal tickets helped. Spent $1000 on useless ads in the process, but have an "unlocked" account now. Really dis
2.
by lorey 1mo ago
Found this to display the optimal LLM choice while building evalry. It's such a useful tool, not only for thinking about it, but for visualization, too. Example: Which LLM gives me the best ELI5 explanations for a given price. https:&
3.
by lorey 2mo ago
What I read from that is that there's a chance claude gets worse using a claude.md and that's a usability issue on their side.
4.
by lorey 3mo ago
Their response: > The team that made dataroom has stated that they did not use any of papermark’s code and that dataroom was made from scratch with inspiration from existing document sharing softwares, and that this post’s allegations of
5.
by lorey 8mo ago
That is not what the article argues.
6.
by lorey 8mo ago
Haha, very true. Exactly as described in the article.
7.
by lorey 8mo ago
This is true with one caveat. In most cases, e.g. with regular ML, evals are easy and not doing them results in inferior performance. With LLMs, especially frontier LLMs, this has flipped. Not doing them will likely give you alight performa
8.
by lorey 8mo ago
This is a very good point. When I came in, the founder did a lot of evaluation based on a few prompts and with manual evaluation, exactly as described. Showing the results helped me underline the fact that "works for me" (tm) does
9.
by lorey 8mo ago
Doesn't this depend a lot on private vs company usage? There's no way I could spend more than a few hundreds alone, but when you run prompts on 1M entities in some corporate use case, this will incur costs, no matter how cheap the
10.
by lorey 8mo ago
It's not you, it's the HN hug of death. There's so much load on the server, I'm barely able to download the redis image I need for caching...
11.
by lorey 8mo ago
Thanks. Will take a look.
12.
by lorey 8mo ago
Depends on your remaining budget ;)
13.
by lorey 8mo ago
I've skipped that in the article, but absolutely!
14.
by lorey 8mo ago
Fixed, thanks. Not a native speaker.
15.
by lorey 8mo ago
That's interesting. Similarly, we found out that for very simple tasks the older Haiku models are interesting as they're cheaper than the latest Haiku models and often perform equally well.
16.
by lorey 8mo ago
Pushed a fix. Could you check, please? Any resources you can recommend to properly tackle this going forward?
17.
by lorey 8mo ago
Will fix, thanks :)
18.
by lorey 8mo ago
Totally agree with your point. While I can't say specifically, it's a traditional (German) business he's doing vertically integrated with AI. Customer support is really bad in this traditional niche and by leveraging AI on to
19.
by lorey 8mo ago
This went straight to prod, even earlier than I'd opted for. What do you mean?
20.
by lorey 8mo ago
Appreciate the feedback, will work on that.
21.
by lorey 8mo ago
You're right. We did a few use cases and I have to admit that while customer service is easiest to explain, its where I'd also not choose the cheapest model for said reasons.
22.
by lorey 8mo ago
Yes, absolutely. This aligns with what we found. It seems to be necessary to be very clear on scoring (at least for Opus 4.5).
23.
Without benchmarking LLMs, you're likely overpaying(karllorey.com)
197 points by lorey 8mo ago|93 comments
24.
by lorey 9mo ago
Very interesting points. Would you mind sharing a few examples of when cherry-picking is necessary and why atomic changes are a lie? I'm using a monorepo for my company across 3+ products and so far we're deploying from stable rel
25.
by lorey 9mo ago
Yes, there's the <link rel="icon"...> an other specific tags providing far more options than the old favicons. For anyone interested: https://developer.mozilla.org/en-US/docs/Web/HTML&#x2F
26.
by lorey 9mo ago
Thanks, this is how I feel about this, too.
27.
Show HN: Free Logo API – logos for any company or domain(logos.apistemic.com)
9 points by lorey 9mo ago|6 comments
28.
by lorey 10mo ago
Spent the last three months building a competitor/lookalike ML model + API. Started using plain embedding similarity and quickly realized you end up with similar noisy results as ocean.io. Ended up using similarity learning which works
29.
by lorey 1y ago
I don't understand why so many VCs fall for "not invented here". Vibe-coded or not, this is just another in-house solution, inferior and more expensive than most out-of-the-box products already out there.
30.
LLM Benchmarks on Company Data(github.com)
1 points by lorey 1y ago|0 comments

More ›