scottjg

6 ms·

1.
by scottjg 2mo ago
Kaiser is a vertically integrated healthcare provider. They provide insurance like UHC but they also require you, for the most part, to be treated in Kaiser medical facilities. How can UHC use AI in the same way? They're an insurance c
2.
by scottjg 4mo ago
usually the LLM will match against the style in the context, even if the words ask it to do otherwise. since your skill sounds like an LLM wrote it, I would be surprised if it didn't make things worse. sorta like asking an LLM to get m
3.
by scottjg 4mo ago
i admit, you got me chuckling with that one.
4.
by scottjg 4mo ago
interesting. that might be a fun intro project to MoltenVK. I hadn't dug into what was missing for Doom. I thought maybe the issue was that the intro/menu always ran in opengl mode or something. If it's just one missing op, t
5.
by scottjg 4mo ago
custom zoom75
6.
by scottjg 4mo ago
it is a separate stack, but that probably doesn't matter much. a user process (in my case, qemu) can communicate with a driverkit driver. the user process can also map memory through the driver, which is how this pci passthrough system
7.
by scottjg 4mo ago
i don't know for sure, but i suspect what makes the tinygrad stuff slow isn't the macos host driver itself. i think they're doing something very similar to what i'm doing, which is just mapping the PCI BARs to userspace,
8.
by scottjg 4mo ago
thanks! there also appears to be a generic pci passthrough path. we were discussing it on the qemu-devel list: https://lore.kernel.org/qemu-devel/C35B5E97-73F2-4A60-951B-B...
9.
by scottjg 4mo ago
in fairness to the LLM critics, every time i ran into a minor speed bump in this project, it told me it probably just wasn't possible to get it to work well. the LLM did pretty actively discourage me from trying to get the whole thing
10.
by scottjg 4mo ago
the exact numbers in the graph are 17019ms vs 142ms. so you're right, it's not 120x, it's 119.85x.
11.
by scottjg 4mo ago
two semi interesting things to note around this: 1. Virtualization.framework seems to support some form of GPU passthrough from the host (granted, not eGPU - it's for the integrated GPU). I think the primary use case is having macOS gu
12.
You can plug a Thunderbolt eGPU into a Mac to play games and accelerate AI now(scottjg.com)
4 points by scottjg 4mo ago|0 comments
13.
RTX 5090 and M4 MacBook Air: Implementing PCI Passthrough for Gaming(scottjg.com)
11 points by scottjg 5mo ago|0 comments
14.
by scottjg 5mo ago
I very recently ran the numbers on these GPUs for an upcoming blog post. The token generation performance is bad, but the prefill performance is _really_ bad. For a Qwen 3.6 35B / 3B MoE, 4-bit quant: - parsing a 4k prompt on a M4 Macb
15.
by scottjg 8mo ago
we can only hope
16.
by scottjg 8mo ago
a great post that definitely inspired this one. i link to it in the first paragraph of my blog post.
17.
by scottjg 8mo ago
i thought my post was already too long to include this, but to your point, you can run AI inference in this setup and the performance can be pretty good.
18.
by scottjg 8mo ago
you're lucky you didn't get stuck with an S3 ViRGE.
19.
RTX 5090 and Raspberry Pi: Can it game?(scottjg.com)
283 points by scottjg 8mo ago|115 comments
20.
by scottjg 10mo ago
this is mostly right, but it's not true that you can just sign up at any time. there's an open enrollment period for the aca marketplace and if you miss it, you won't have the opportunity to buy health insurance until next ye
21.
by scottjg 1y ago
runway construction is only part of the story, i think. in May, there was a number of complete ATC meltdowns causing ground stops. if you look at the stats, the majority of delays at newark in May are attributed to ATC. personally, i was on
22.
by scottjg 1y ago
i frequently fly in and out of newark
23.
by scottjg 1y ago
may is the latest data currently available.
24.
by scottjg 1y ago
In May, Newark airport flights were on time 49% of the time: https://www.transtats.bts.gov/ot_delay/OT_DelayCause1.asp?20... Maybe in aggregate flights have fewer delays but every single flight I’ve taken this year has
25.
by scottjg 1y ago
i have no doubt that other countries have some problems in their healthcare systems too, but i think you are downplaying a few key points: 1) united healthcare made 90 billion dollars gross profit in the last 12mo, and that's only one
26.
by scottjg 1y ago
i think there are a lot of folks who would be willing to have a 27% discount (allow for ~3% card processing fee) and forego those features. if apple was saying you had to support their payment processor alongside others (so you could opt in
27.
by scottjg 2y ago
don't the incentives seem wrong? they're limited to 10% margin so what's the incentive for them to keep costs down for consumers? they only make more money when the costs go up.
28.
by scottjg 3y ago
out of curiosity, which wifi microcontrollers are better for battery life?
29.
by scottjg 3y ago
i don't know what the penetration of it looks like, but on the vsphere/esxi side there are also a number of really expensive addon features that i have not seen reproduced in open source software. 1. vmotion + storage vmotion - yo
30.
by scottjg 3y ago
it was pretty noticeable to me. i don't think it's the groundwater specifically but they started treating the water with chlorine as part of the change, which you can definitely taste. i installed a filter under the sink and at le

More ›