XMasterrrr

6 ms·

1.
GPU Memory Math for LLMs: Formula That Tells You What Fits on Your GPU(theahmadosman.substack.com)
12 points by XMasterrrr 4mo ago|2 comments
2.
I Built My Wife a Simple Web App for Image Editing Using Flux Kontext(github.com)
2 points by XMasterrrr 1y ago|1 comments
3.
So You Want to Learn LLMs? Here's the Roadmap(ahmadosman.com)
2 points by XMasterrrr 1y ago|2 comments
4.
by XMasterrrr 1y ago
Hey HN, I've been neck-deep in AI and LLMs for a while now, and I kept running into the same problem: every learning resource out there for LLMs either tries to teach you all of deep learning from scratch, or throws you into a sea of r
5.
by XMasterrrr 2y ago
What's your workflow like? I use AI Chat. I load Qwen2.5-1.5B-Instruct with llama.cpp server, fully offloaded to the CPU, and then I config AI Chat to connect to the llama.cpp endpoint.
6.
by XMasterrrr 2y ago
I think I know what he means. I use AI Chat. I load Qwen2.5-1.5B-Instruct with llama.cpp server, fully offloaded to the CPU, and then I config AI Chat to connect to the llama.cpp endpoint. Checkout the demo they have below https:/&#x2
7.
Serving AI from the Basement Part II: SWE Agents, MoEs, Batch Inference, and Mor(ahmadosman.com)
2 points by XMasterrrr 2y ago|1 comments
8.
by XMasterrrr 2y ago
Hey guys, If you remember, I shared my first blogpost here a couple of weeks ago Serving AI From The Basement ( https://ahmadosman.com/blog/basement-ai-resident/serving-ai-... ) and there was a great and lively disc
9.
by XMasterrrr 2y ago
You've got a much stronger heart than me man
10.
by XMasterrrr 2y ago
Most outlets rely on 120v 15amp breakers here in the US, only washer/dryer/kitchenware require the higher end 240v breakers
11.
by XMasterrrr 2y ago
Yup, that's exactly what I had installed.
12.
by XMasterrrr 2y ago
Yeah, you get it. I have two PDUs with NEMA L6-30P plugin, and two NEMA L6-30R outlet. Each outlet is connected to it's dedicated 30A 240v circuit (which gives you a total of 60A, or 6000w). Cooling is its own story... Man, figuring ou
13.
by XMasterrrr 2y ago
If that is true and OP is not just confused, he should sue his landlord, and I am not even kidding!!!
14.
by XMasterrrr 2y ago
What kind of a dryer? Because that cannot be right. Dryers require a 30amp 240volt dedicated breakers by code in most counties in most states nowadays.
15.
by XMasterrrr 2y ago
Actually, putting each PSU on its own circuit is crazy dangerous. In the scenario of your suggestion, if one goes out, you are in for a fire. Highly recommend against that.
16.
by XMasterrrr 2y ago
Let me know if you figure it out, I would be really interested hahaha
17.
by XMasterrrr 2y ago
I agree with you on all of that. I went down the rabbit hole to understand what's up, but I also hired someone and told them exactly what I wanted: breakers amps and volts, outlets type, surge protector over the entire breaker box up t
18.
by XMasterrrr 2y ago
A year ago it was a struggle to get one for anything below $2100 pre-tex. Glad it came down a bit.
19.
by XMasterrrr 2y ago
Yeah, you get it. I am using 3x 1600w 240V Platinum PSUs from Superflower (They're the manufacturer of EVGAs PSUs. Top notch stuff, did my homework) I however decided against server PSUs like the one you suggested because the extra set
20.
by XMasterrrr 2y ago
Hey man, I think I came across your blog at some point before while trying to figure out my own power plan for this beast (check my comment to OP for more context), so kudos to you for that. I would say that power limiting is a potential wo
21.
by XMasterrrr 2y ago
Oh yeah, my original setup was an RTX 4090 + an RTX 3090, and I swear one night I had the circuit breaker trip more than 15 times before I gave up. I have a UPS so I would run to the box before my system shuts down. Most houses are equipped
22.
Serving AI from the Basement – 192GB of VRAM Setup(ahmadosman.com)
318 points by XMasterrrr 2y ago|268 comments
23.
by XMasterrrr 2y ago
Hey guys, this is something I have been intending to share here for a while. This setup took me some time to plan and put together, and then some more time to explore the software part of things and the possibilities that came with it. Part
24.
by XMasterrrr 3y ago
Both.
25.
by XMasterrrr 3y ago
That's the client I use on daily basis and it's been one of my favorite apps
26.
by XMasterrrr 3y ago
That's very neat, any chance you'd be willing to open source it?
27.
by XMasterrrr 3y ago
This sounds like an excellent fit for me, is there a way I can connect with you?
28.
by XMasterrrr 8y ago
I completely agree with what you're saying. This is terrorism. This is Islamophobia. This is hatred. And all of that needs to stop.
29.
by XMasterrrr 8y ago
Thanks for reminding us, all of us, that the people affected by hate crimes are people with stories, just like us, not numbers. Same ambitious, similar hobbies, beloved, and gone too soon.
30.
Bandersnatch.Life – An Interactive Black Mirror: Bandersnatch Paths Website(github.com)
3 points by XMasterrrr 8y ago|0 comments

More ›