ftufek

23 ms·

1.
by ftufek 1y ago
https://huggingface.co/models is usually good place to look, you can sort by trending and filter by the task you care about (ex: Image-Text-to-Text). The first page will usually have the leading edge/newer models.
2.
by ftufek 2y ago
Yeah, some people say they got replacements through the warranty. The problem is, this thing is really big and heavy, so boxing it up is a real pain, especially if you've had it a while and already threw out the original box.
3.
by ftufek 2y ago
Unfortunately those "solutions" don't work, the person who had a potential solution was able to at least go through the inputs, this is not the case here, you can't even go through the inputs. I've tried all the pot
4.
Samsung Q990D unresponsive after 1020 firmware update(us.community.samsung.com)
591 points by ftufek 2y ago|562 comments
5.
by ftufek 2y ago
Their consumer cards are the entry point for many researchers and students though, so it pays off eventually when they become engineers working with the expensive enterprise cards.
6.
by ftufek 2y ago
It's not just the home insurance either. Last week, I bought a car and 3 of the big insurance companies refused to insure it without a 15 days waiting/underwriting period (Geico which I've had for many years, State Farm and P
7.
by ftufek 3y ago
You'll need something like EPYC/Xeon CPUs and motherboards which not only have many more PCIe lanes, but also allow bifurcation. Once you have that, you can get bifurcated risers and have many GPUs. And these risers use normal cab
8.
by ftufek 3y ago
Yeah, it's really just trying to get as much compute as possible as cheaply as possible interconnected in a reasonably fast way with low latency. Slow networking would be a bottleneck and expensive high end networking would defeat the
9.
by ftufek 3y ago
I meant each card is limited to 240w, instead of the usual 450w. Also, it's more like 4 circuits after all, because the main cpu/mb/2gpus are on a 15a too.
10.
by ftufek 3y ago
Never got around to writing some public docs. It's essentially bunch of GPUs on custom aluminum extrusion frames sitting in a server rack, connected to romed8-2t motherboard through pcie splitters. Power limited to 240w, negligible per
11.
by ftufek 3y ago
Really depends on the model and the software tricks you're using. With DDP and gradient accumulation, you can reduce the bandwidth bottleneck by quite a bit. We've trained with 4090s running at x4 lanes with very small impact. And
12.
by ftufek 3y ago
Local workstation is much cheaper in the long run. Even ignoring that, most of the development is running experiments. You're gonna be hesitant to run lots of experiments if they each cost money whereas when you pay upfront for the har
13.
by ftufek 3y ago
I've been seeing a bunch of them in Bay Area, I thought it was already launched and started deliveries. In person, it looks like something out of a movie set.
14.
Show HN: Instant AI portraits, generate pics of yourself in a few seconds(faceshape.com)
5 points by ftufek 3y ago|2 comments
15.
by ftufek 3y ago
The release event is in like ~30 minutes on their discord, probably the announcement went out a bit early.
16.
by ftufek 3y ago
1. You can pair normal atx PSUs for the motherboard/CPU and server PSUs for the GPUs using breakout boards. 2. You can power limit GPUs down to 250W and barely lose any performance depending on your use case, highly recommend it. So an
17.
by ftufek 3y ago
My guess is this isn't their competitive edge, network effects, products, data and distribution is. In a way, it takes away their competitors edge while racing to the bottom to compete with open source. At the same time, they establish
18.
by ftufek 3y ago
I think less effort has gone into image editing compared to image generation so far. That said, we're building some photo realistic image editing tools at https://www.faceshape.com , focused on face editing for now. Current
19.
by ftufek 3y ago
I wrote it from the perspective of a small startup (<10 people, bootstrapped or small funding). I think it's far cheaper and easier to build a nice competitive mobile app/saas than to build a really useful model. But yes I agre
20.
by ftufek 3y ago
I've tried it, sure it's good, but not even close to the real thing. But yes it's getting cheaper through better hardware, better data and better architectures. Also it builds on Facebook's models that were trained for m
21.
by ftufek 3y ago
It's easier for large rich companies with infrastructure and datasets. It's very hard for small startups to build useful real world models from scratch, so you see most people building on top of SD and APIs, but that limits what y
22.
by ftufek 4y ago
Yeah I agree it's too slow for autocompletion at the moment, but this would be for full feature implementations, not just autocomplete. For example, if I have a repo I want to add a table and rest api implementation in, it can do this:
23.
by ftufek 4y ago
This is awesome, can't wait to get api access to the 32k token model. Rather than this approach of just converting the whole repo to a text file, what I'm thinking is, you can let the model decide the most relevant files. The init
24.
by ftufek 4y ago
It has no post-2021 knowledge, but while playing with it, I found that you can just paste the documentation (no need to even format it) and it'll just "learn" it. For example, safetensors wasn't available back then appar
25.
by ftufek 4y ago
Have you looked into cloudflare tunnels/ngrok? You can expose any service to internet without dealing with ip addresses, firewalls or opening ports, etc. And tailscale can also give you a private access to any resources even if it&#x27
26.
by ftufek 4y ago
L5 used to be the terminal level, at least for most engineers. L8+ is very rare in my experience.
27.
by ftufek 4y ago
> Also: Almost everyone using GPUs for work will join NVIDIA's Inception program and get rebates... So why look at retail prices? Out of curiosity, does that also apply for consumer grade GPUs?
28.
by ftufek 4y ago
The article mentions the 8 bit quantization, I believe this is about training in fp8 as native format. The latest GPUs provide huge flops for those, Tim Dettmers updated his gpu article and he talks about this, the claim is 0.66 PFLOPS for
29.
by ftufek 4y ago
I think it's a combination of many things. Very powerful compute, very large datasets, transformers and diffusion models and a ton of research by lots of researchers easily available on arxiv, etc.
30.
by ftufek 4y ago
From my experience playing around with dreambooth in the last few weeks generating images of a specific person or pet (not just a generic concept), it surprisingly works really well. But you have to make sure to feed it enough pictures, mak

More ›