jonas_scholz

6 ms·

1.
by jonas_scholz 2mo ago
They wont, they are very public about never subsidising any products. I doubt they change that after 29 years now.
2.
by jonas_scholz 2mo ago
also slightly disrespectful to think that this was a single prompt, but ok:D
3.
by jonas_scholz 2mo ago
yeah, but why would LLM inference now triple the price of the other products? Or am I misunderstanding what you're saying?
4.
by jonas_scholz 2mo ago
"no reason" like hardware prices going through the roof?
5.
by jonas_scholz 2mo ago
Why do you think this would be madness? It seems like, at least in the EU, there is barely competition for the big open-weight models?
6.
by jonas_scholz 2mo ago
fine, i agree that this doesnt sound like me. But the content is correct and not a hallucination!
7.
by jonas_scholz 2mo ago
I mostly use Hetzner baremetal servers and not cloud, but the support there is in my experience very competent, but also VERY german and direct. I can imagine if youre neither german or super technical that this can be intimidating or consi
8.
by jonas_scholz 2mo ago
what is the hallucination here? it is fast, free and fun to try. And I genuinely think that the hardware decision (if they get bigger gpus) decides if this will be a banger product or not?
9.
by jonas_scholz 2mo ago
yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane
10.
by jonas_scholz 2mo ago
I really hope they dont stop at the small models though! The bigger ones that dont fit on a single GPU are more interesting I think
11.
by jonas_scholz 2mo ago
agree. I have a usecase for a bigger open-weight model hosted by an EU company and the selection isnt really great, hard to make the regulatory gods (and the devs) happy at the same time right now
12.
by jonas_scholz 2mo ago
My writing wasnt clear here I think, without the option it defaults to reasoning enabled. With "without it" I meant without enable_thinking=False!
13.
by jonas_scholz 2mo ago
Interesting, didn’t know about them! Weird model selection though, no glm or deepseek?
14.
Hetzner is working on LLM Inference(sliplane.io)
156 points by jonas_scholz 2mo ago|86 comments
15.
We built our own DNS server(sliplane.io)
2 points by jonas_scholz 5mo ago|0 comments
16.
by jonas_scholz 8mo ago
we love and support netbird at sliplane <3 https://docs.sliplane.io/private-networking/netbird
17.
What the Fuck Is a Vcpu?(sliplane.io)
2 points by jonas_scholz 8mo ago|0 comments
18.
by jonas_scholz 10mo ago
Thank you for mentioning Sliplane! Really cool project.
19.
Fly Away from Fly.io(sliplane.io)
4 points by jonas_scholz 1y ago|0 comments
20.
by jonas_scholz 2y ago
afaik no firecracker support with virt-manager. There's firectl to make it a bit easier but the tooling is generally still pretty rough
21.
Firecracker vs. QEMU(e2b.dev)
7 points by jonas_scholz 2y ago|3 comments
22.
by jonas_scholz 2y ago
Yes, we're on Hetzner! The availability is actually insane. Thank you :)
23.
by jonas_scholz 2y ago
Thats cool! Id like to check that out if you want to share! jonas@sliplane.io or you can find me on Twitter/X (JonasScholz19) :)
24.
by jonas_scholz 2y ago
BTW, this is also kinda how Sliplane started. We both are coming from a freelancing background and had built similar things for clients before
25.
by jonas_scholz 2y ago
Yes! And its not like we don't care about that or don't want to follow all the rules, it's just really hard. Especially when you're not funded and a tiny team.
26.
by jonas_scholz 2y ago
We are working on that! One of our most requested features
27.
by jonas_scholz 2y ago
docker compose is one of our most requested features, we're working on that!
28.
by jonas_scholz 2y ago
Yeah fair point, its a bit confusing. We really wanted to have the cheapest price under 10, and just kept the other prices at a point that make this business sustainable for us. Pricing is hard :D
29.
by jonas_scholz 2y ago
Good point, will change that asap. Thanks!
30.
by jonas_scholz 2y ago
Thanks! No, I dont think this is a direction we want to go in. For now we are focused on simpler usecases :)

More ›