tsurba

6 ms·

1.
by tsurba 3mo ago
And so animals wouldn’t be conscious because they don’t use language? If so, I vote that the stupidest hypothesis of the year. Or would one count any communication between animals as language? In that case almost any interaction would count
2.
by tsurba 4mo ago
Joplin is open source, syncing setup between devices is one login to Dropbox, works for free, with native apps on Windows/OSX/Linux/iOS/Android. It has a bunch of plugins too. If you just need markdown files with syncing
3.
by tsurba 9mo ago
True, good point, maybe not a straightforward consequence to extend to weights.
4.
by tsurba 9mo ago
Many discriminative models converge to same representation space up to a linear transformation. Makes sense that a linear transformation (like PCA) would be able to undo that transformation. https://arxiv.org/abs/2007.0
5.
by tsurba 9mo ago
Edit: actually this paper is the canonical reference (?): https://arxiv.org/abs/2007.00810 models converge to same space up to a linear transformation. Makes sense that a linear transformation (like PCA) would be able
6.
by tsurba 9mo ago
You can show for example that siamese encoders for time-series, with MSE loss on similarity, without a decoder , will converge to the the same latent space up to orthogonal transformations (as MSE is kinda like gaussian prior which doesn’
7.
by tsurba 1y ago
But are we close to doing that in real-time on any reasonably large model? I don’t think so.
8.
by tsurba 1y ago
I agree with everything up until the AI part, and for that part too, the general idea is good and worth worrying about. I’m scared af about what happens to kids who do all their homework with LLMs. Thankfully at least we still have free and
9.
by tsurba 1y ago
Thankfully in the EU you are not even allowed to sell sunglasses without proper UV protection, and can just pick up sunglasses from any market and trust they are fine, if a little flimsy. EDIT: ok apparently anywhere else than the poorest o
10.
by tsurba 1y ago
And how long have you been doing this? Because that sounds naive. After doing programming for a decade or two, the actual act of programming is not enough to be ”creative problem solving”, it’s the domain and set of problems you get to appl
11.
by tsurba 1y ago
Gambling is where I end up if I’m tired and try to get an LLM to build my hobby project for me from scratch in one go, not really bothering to read the code properly. It’s stupid and a waste of time. Sometimes it’s easier to get started th
12.
by tsurba 1y ago
Is it a puzzle if there is no algorithm? But testing via coding algos to known puzzles is problematic as the code may be in the training set. Hence you need new puzzles, which is kinda what ARC was meant to do, right? Too bad OpenAI lost cr
13.
by tsurba 1y ago
I would argue the other way around. I have ADHD, but the thing that really helped me with work procrastination, which I think would help even without ADHD, was to find a job that is actually interesting. In approx 7 years I went through wor
14.
by tsurba 1y ago
1.5-2 years ago I did some training for a ML paper on 4 AMD MI250x (each is essentially 2 gpus so 8 in total really, each with 64GB VRAM) on LUMI. My Jax models and the baseline PyTorch models were quite easy to set up there, and there was
15.
by tsurba 1y ago
Yet somehow chatting with Gemini in the web interface, it forgets everything after 3 messages, while GPT (almost) always feels natural in long back-and-forths. It’s been like this for at least a year.
16.
by tsurba 1y ago
I do machine learning research and it is very useful for working out equations and checking for ”does this concept already have an established name” etc. It is also excellent for writing one-off code experiments and plots, saving some time
17.
by tsurba 1y ago
OSS alternatives with free syncing to your chosen cloud already exist, and have plugin systems. Why not just contribute to those? Because this is either advertising or procrastination.
18.
by tsurba 1y ago
Or use Joplin which is open source and also creates markdown files, and setting up sync to a cloud provider that you probably already have is free.
19.
by tsurba 1y ago
Just use Joplin, it’s open source and syncing to many cloud providers you already probably have is free.
20.
by tsurba 1y ago
And going to a grocery store instead of 37 individual farmers…?
21.
by tsurba 1y ago
Nice that someone realized then already it sounds sus https://news.ycombinator.com/item?id=42128532
22.
by tsurba 1y ago
Probably why they tried to address it in the abstract already
23.
by tsurba 1y ago
I guess SO was quite useful for providing a lot of training material for technical question answering for LLMs? I don’t think they got compensated for it so that is a bit sad. In terms of my use, most questions and answers either were low q
24.
by tsurba 1y ago
The best thing to feed the podcast is a dump of all one-liner macros we’ve added to an IRC bot over 15 years (for fetching weather, stocks, and 99% stupid jokes) without any context. Cannot stop laughing listening to it trying to figure it
25.
by tsurba 1y ago
Good art is not going out of fashion. Tools may change but part of an artists job is to adapt. For example, when you learn instruments you also train your ear and taste. These are things one cannot take shortcuts in. I wouldn’t worry about
26.
by tsurba 1y ago
Yep not going to bother reading these hype advertisements about things that are not even available. This sucks so much from Google.
27.
by tsurba 1y ago
I actually enjoyed the article and the variety of drum beats, and the spectrograms, even though we have completely different woodpeckers here in Finland.
28.
by tsurba 1y ago
I don’t believe so. I think all important parts that each need to be scaled to advance significantly in the LLM paradigm are at or near the end of the steep part of the sigmoid: 1) useful training data available in the internet 2) number o
29.
by tsurba 1y ago
If figuring out how computers work starting all the way from logic gates interests you, but you don’t want to start by ordering parts and soldering, check out the ”game” Turing Complete. Of course it’s not the same thing as actually buildin
30.
by tsurba 2y ago
Proper initialization is more important. Batch norm and others are important for faster convergence due to forcing the model to focus creating second and higher order nonlinearities, as a simple shift in mean/std is normalized out, and

More ›