HighFreqAsuka

5 ms·

1.
by HighFreqAsuka 8mo ago
Take a look at The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text ( https://arxiv.org/pdf/2506.05209 ). They build a reasonable 7B parameter model using only open-licensed data.
2.
by HighFreqAsuka 1y ago
Fruition is my entry recommendation. Every bar they make is good. Then Castronova, Goodnow Farms, Askinosie, Soma, and Dick Taylor. A good heuristic for evaluating a new brand is if the package tells you where the beans are from and if the
3.
by HighFreqAsuka 1y ago
> Here’s what we’ve found out: It’s not about the cocoa-beans, but about the way they are treated during the manufacturing process. I eat a lot of high end single origin chocolate bars, and I simply don’t believe this. Two bars from the
4.
by HighFreqAsuka 2y ago
We've collectively failed at this problem as a society. We've 1. made it extremely difficult, even illegal, to build more denser housing. 2. devalued the status of electricians, plumbers, and carpenters leading to a shortage of
5.
by HighFreqAsuka 3y ago
Did you not read the word “potentially”? Topological spaces are a more general case of spaces that contain the discrete case as a subset.
6.
by HighFreqAsuka 3y ago
By having nearly no volume to begin with. Many US stocks are listed across many of the ~13 US exchanges, so what you're describing is already the status quo. According to RegNMS regulations, traders cannot trade through protected quote
7.
by HighFreqAsuka 3y ago
The point of that comment doesn't have anything to do with how ResNets actually work. You missed the actual point. > We don’t actually know why resnets work so well. Yes actually we do. We know, from the literature, that very deep n
8.
by HighFreqAsuka 3y ago
Yes, I have a very good point in fact. But the above comment purposely chooses not to argue with it, because it's easier to ignore it entirely and argue something else.
9.
by HighFreqAsuka 3y ago
Empirically yes, I can consider a very deep fully-connected network, measure the gradients in each layer with and without skip connections, and compare. I can do this across multiple seeds and run a statistical test on the deltas.
10.
by HighFreqAsuka 3y ago
No, there are many very mathematically inclined deep learning researchers. It's an empirical science because the mathematical tools we possess are not sufficient to describe the phenomena we observe and make predictions under one unifi
11.
by HighFreqAsuka 3y ago
Just read the section on ResNets (Section 1.5) and tell me if you think that's the best way to explain ResNets to literally anyone. Tell me if, from that description, you take away that the reason skip connections improve performance i
12.
by HighFreqAsuka 3y ago
I agree with that, I think UDL uses the necessary amount of math to communicate the ideas correctly. That is obviously a good thing. What it does not do is pretend to be presenting a mathematical theory of deep learning. Basically UDL is ex
13.
by HighFreqAsuka 3y ago
I've seen quite a few of these books attempting to explain deep learning from a mathematical perspective and it always surprises me. Deep learning is clearly an empirical science for the time being, and very little theoretical work tha
14.
by HighFreqAsuka 3y ago
Looks like you left the submissions instructions for AISTATS on the last page of the PDF. Don't know if that was intentional but I'm guessing it wasn't.
15.
by HighFreqAsuka 3y ago
> however, it was not truly "independent", Of course I don't mean to imply they operate in a vacuum. They can obviously see competitors raising their prices. I just mean to say they don't get into a room and actively
16.
by HighFreqAsuka 3y ago
There's a theory, price-over-volume, that the sudden shift in demand and expectation of inflation gave companies room to explore a different point on the revenue curve, where they increase the price and simply sell less volume. Prior t
17.
by HighFreqAsuka 3y ago
Just for clarity, the linked paper in the twitter thread is "An autonomous laboratory for the accelerated synthesis of novel materials" ( https://www.nature.com/articles/s41586-023-06734-w ) which does have two
18.
by HighFreqAsuka 3y ago
Transformers have disadvantages too, and so LSTMs are still used in industry. But also it's not that hard to learn a couple new things every year.
19.
by HighFreqAsuka 3y ago
Quite a lot of techniques in deep learning have stood the test of time at this point. Also new techniques are developed either depending on or trying to solved deficiencies in old techniques. For example Transformers were developed to solve
20.
by HighFreqAsuka 3y ago
Because he's the former president of YC. One of the powerful people you'd be pissing of by doing this is Sam Altman.
21.
by HighFreqAsuka 3y ago
You'd be getting on the bad side of some of the most powerful people in tech and taking the helm of a company full of people who don't want you running it. It's not a surprise a lot of people don't want the role.
22.
by HighFreqAsuka 3y ago
I think it's pretty clear by this point that the board consists of several people who are woefully ignorant about the way the world actually works.
23.
by HighFreqAsuka 3y ago
These simply can't be the real reasons.
24.
by HighFreqAsuka 3y ago
Whenever I run into a doctor like this I just assume they're willfully ignorant because they don't want to rock the boat. How can you not be curious about such a large part of your profession?! It's a pretty negative signal i
25.
by HighFreqAsuka 3y ago
In computational geometry, Raimund Seidel wrote a paper that proves an upper bound theorem for polytopes in two sentences in the abstract. The rest of the paper just comments on the result. https://www.sciencedirect.com/scie