alexeldeib

6 ms·

1.
by alexeldeib 22d ago
What issues do you see in practice? This seems pretty easily "fixable"
2.
by alexeldeib 2mo ago
Why are those incompatible? Pricing is 10% under moonshot, and pure infra providers also want money
3.
by alexeldeib 6mo ago
KV cache is, well, a cache that can fill up and trigger eviction. You require enough space to execute at least 1 fwd pass of 1 request at your context length. KV cache hits reduce TTFT by avoiding prefill. You don’t get to skip decode. MoE
4.
by alexeldeib 10mo ago
“It depends”: what’s your prior experience, what kind of roles interest you, how big is the gap between what you have + a little ML knowledge/side projects? I’d argue there’s a big need for people with solid fundamental CS, sysadmin, i
5.
by alexeldeib 11mo ago
as someone in the space this ticks a lot of boxes: kubernetes-native, strong isolation, python sdk (ideal for ML scenarios). devmapper is a nice ootb approach. Glancing at the readme, is your business model technical support? Or what's
6.
by alexeldeib 11mo ago
Fun one: https://incident.io/blog/festive-macbooks
7.
by alexeldeib 11mo ago
Oh nice! I just had an excuse to try mojo via max inference, it was pretty impressive. Basically on par with vllm for some small benchmarks, bit of variance in ttft and tpot. Very cool!
8.
by alexeldeib 11mo ago
ouch, last “recent update” in 2023. Any idea what happened?
9.
by alexeldeib 1y ago
Larger memory, weaker comms. You can optimize for this by doing things like increasing batch size/data parallelism vs sharding schemes with more comms. At scale training won’t be able to avoid comms entirely, while many models can fit
10.
by alexeldeib 1y ago
can't speak to GCP specifically but usually the issue is they are host-attached and can't be migrated, so need to be wiped on VM termination or migration -- that's when you lose data. Reboots typically don't otherwise do
11.
by alexeldeib 1y ago
yeah, the system/application distinction feels somewhat superficial. The “multiple user space” inside a container thing sounds interesting (not sure what that means exactly), but maybe more similar to a Kubernetes pod, except maybe ins
12.
by alexeldeib 1y ago
The "first" link (after the home button) on bbchallenge is the header bar link to https://bbchallenge.org/story which cites Aaronson in the first sentence (double first!). I would not describe it like OP for someo
13.
by alexeldeib 1y ago
that's kind of a thing with https://docs.rs/no-panic/latest/no_panic/ or no std and custom panic handlers. not sure what the latest is in the space, if I recall there are some subtleties
14.
by alexeldeib 1y ago
Brightline https://www.gobrightline.com/ Never had the chance to use it, but one of the more exciting US rail developments I’ve seen recently.
15.
by alexeldeib 2y ago
you seen kubie? `kubie ctx` is great for avoiding the first issue https://github.com/sbstp/kubie
16.
by alexeldeib 2y ago
Supabase would be a good pick. Vercel and Cloudflare both do SQL DBs now too, curious how they are. Neon seemed interesting, haven’t heard much about them in a while. None of those integrated of course, but easier than going big cloud or s
17.
by alexeldeib 2y ago
great talk! I’m curious about an approach like this combined with CUDA checkpoint for GPU workloads https://github.com/NVIDIA/cuda-checkpoint
18.
by alexeldeib 2y ago
What was your takeaway? Any added insights/reading?
19.
by alexeldeib 2y ago
Isn’t there an argument we’re simply better at brain statistics and modeling than current AI? Forget architectural limitations. What is the nature of the extrapolation? How do individuals balance their experiences and determine likely outco
20.
by alexeldeib 2y ago
have you seen systemd-analyze?
21.
by alexeldeib 3y ago
This is the classic Dropbox criticism, no? Moreover, the pleasure has nothing to do with self hosting or not, it’s just a pleasant and whimsical UX while being technically solid.
22.
by alexeldeib 3y ago
They allegedly tried chromium without luck.
23.
by alexeldeib 3y ago
Fair question. This is where I’m struggling and part of the reason I ask the question. On some things, it’s likely I neither have a chance nor would they want me interfering. I respect that. On others, it’s clear they want help or would acc
24.
Ask HN: How to remotely support older parents with bad health/lifestyle habits?
3 points by alexeldeib 3y ago|4 comments
25.
by alexeldeib 3y ago
From the description, I’d think this is all in cluster, not public.
26.
by alexeldeib 3y ago
Huh! Does this account for the difference between what we perceive as "room temperature" and our body temperature? I suppose that delta in temperature depends on medium the body is surrounded by and effectiveness of heat transfer
27.
by alexeldeib 3y ago
Does it work with lower temps? I’ve always found it odd that human body temp is close to 100F but getting into 90 degree water feels hot. I wonder if it’s the evaporative effect like you said and if it reverses when it’s hot enough. Like if
28.
by alexeldeib 3y ago
The article mentions avoiding overcommit and oom score adjust. You can avoid overcommit by always specifying requests == limits and can use priority class for oom score adjust. There are definitely improvements like memory qos/pressure
29.
by alexeldeib 3y ago
Doesn’t this still exist? You Force Touch the space bar and get a cursor
30.
by alexeldeib 3y ago
I think iOS has http proxy settings in the wifi configuration for a given network? Haven’t tried recently.

More ›