topwalktown

6 ms·

1.
by topwalktown 21d ago
"Overall, we attempted to download 130M videos and achieved a link success rate of approximately 60%, resulting in 80M successfully retrieved videos with a total duration of 10M hours." I am astonished that the success rate is so
2.
by topwalktown 6mo ago
I wrote it myself it python. The model runs in a loop and can either read the terminal or input keys. If it does neither the loop exits.
3.
by topwalktown 6mo ago
Sorry! It should work now.
4.
Can AI Exit Vim?(theadamcolton.github.io)
37 points by topwalktown 6mo ago|23 comments
5.
by topwalktown 6mo ago
I test if qwen3.5-35B-A3B can exit vim when running in a harness that allows it to read the raw terminal buffer and send raw key presses to the terminal. Enjoy!
6.
Spokester1: Realtime Neural Game Graphics(theadamcolton.github.io)
1 points by topwalktown 9mo ago|0 comments
7.
by topwalktown 2y ago
Transformers like Llama use rotary embeddings which are applied in every single attention layer https://github.com/huggingface/transformers/blob/222505c7e4d...
8.
by topwalktown 2y ago
I'm trying to train a variable resolution ViT using IJEPA. I'm currently topping out at about 30% on imagenet1k after training for 20 epochs (6 hours) It'd be cool to have some help and feedback. I'm on the right track t
9.
Image Self Supervised Learning on a Shoestring(theadamcolton.github.io)
4 points by topwalktown 2y ago|1 comments
10.
Generative modelling of compressed image file bits(theadamcolton.github.io)
1 points by topwalktown 3y ago|1 comments
11.
by topwalktown 3y ago
i experiment with using a (mostly) unmodified llama model to generate images, by training on the bits from a lossy compression algorithm. It turns out the key is having a decoder which can give 'hints' as conditioning information
12.
by topwalktown 3y ago
yeah, check out the Emu paper by meta. They basically do all of what is mentioned in the above comment
13.
by topwalktown 3y ago
Quantization also works as regularization; it stops the neural network from being able to use arbitrarily complex internal rules. But really it's only really useful if you absolutely need to have a discrete embedding space for some sor
14.
Your VAE Sucks(theadamcolton.github.io)
4 points by topwalktown 3y ago|1 comments
15.
by topwalktown 3y ago
I wrote a short article about jpg and if we could use concepts from how jpg works to make an image autoencoder that has a left-to-right positional bias and variable compression Basically, existing VAEs are pretty good at compression, but ha