stevenwalton

6 ms·

1.
by stevenwalton 11mo ago
> To any Linux users, I have a Macbook Air and I pretty much use it as an ssh machine. It is definitely over priced for that, but it at least beats the annoyance of having to deal with Windows and all the Word docs I get sent or
2.
by stevenwalton 1y ago
> Once you have it on disk, how do you get it away from your phone? Since we're talking about Android, a great method is to just use Termux and rsync. You can write a pretty quick and dirty shell script to accomplish this. H
3.
by stevenwalton 2y ago
Sure, but this doesn't really scale very well. Distributing those APKs without internet access is pretty hard.
4.
by stevenwalton 2y ago
> so we could not hop on WiFi and message each other using Signal. I have a feature request for this actually. I think if it got a harder push they would consider it. It's not full decentralization but does still prevent th
5.
by stevenwalton 2y ago
I've really been trying to get Signal to get some decentralization[0] but unfortunately I pissed off some mods. I do understand their reasoning for staying away from full decentralization, both Moxie and Meredith have made good argum
6.
by stevenwalton 2y ago
> Why on earth, when you go to 192.168.whatever:8096 does it ask you what server you want to connect to? I don't know what the answer is, but I ran into this when I was trying to harden my systemd settings. I'll link my overrid
7.
by stevenwalton 2y ago
> how much are GenAI companies willing to invest to get eyeball reflections right? Willing to? Probably not much. Should? A WHOLE LOT. It is the whole enchilada. While this might not seem like a big issue and truthfully most people don&#
8.
by stevenwalton 2y ago
> But the constraint that both eyes should have consistent reflection patterns is just another statistical regularity that appears in real photographs Hi, author here of a model that does really good on this[0]. My model is SOTA and has
9.
by stevenwalton 2y ago
I'm just curious, why not build ontop of another app like Signal?[0] My understanding is that there's nothing stopping anyone from using the same app and creating their own server and nodes. My understanding is that you can even h
10.
by stevenwalton 3y ago
Yeah so I can get how that might be confusing. Sometimes code is clearer. So in the vanilla transformer you do a patch and then embed operation, right? A quick way to do that is actually with non-overlapping convolutions. Your strides are t
11.
by stevenwalton 3y ago
Logged into my personal account for this one! I'm a lead author on a paper that explored exactly. It does enable faster training and smaller model sizes. For reference, you can get 80% accuracy on CIFAR-10 in ~30 minutes of CPU (not us
12.
by stevenwalton 5y ago
Sure thing. Also if you're getting into transformers I'd recommend lucidrains's GitHub[0] since it has a large collection of them with links to papers. It's nice that things are consolidated. [0] https://githu
13.
by stevenwalton 5y ago
> Are transformers competitive with (for example) CNNs on vision-related tasks when there's less data available? They can be, there's current research into the tradeoffs between local inductive bias (information from local rece
14.
by stevenwalton 5y ago
Lots of people transfer learn with transformers. ViT[0] originally did CIFAR with it. Then DeiT[1] introduced some knowledge transfer (note: their student is larger than the teacher). ViT pretrained on both ImageNet21k and JFT-300m. CCT ([1