obastani

6 ms·

1.
by obastani 6mo ago
I don't know if this is the future, but if it is, why bother building one version of the software for everyone? We can have agents build the website for each user exactly the way they want. That would be the most exciting possibility t
2.
by obastani 6mo ago
This idea leads to the p-adic numbers: https://en.wikipedia.org/wiki/P-adic_number
3.
Effective Reinforcement Learning for Reasoning in Language Models(arxiv.org)
4 points by obastani 1y ago|0 comments
4.
by obastani 2y ago
It's not about training directly on the test set, it's about people discussing questions in the test set online (e.g., in forums), and then this data is swept up into the training set. That's what makes test set contamination
5.
by obastani 2y ago
If I'm understanding correctly, by "income", this article means "actual individual consumption", which is the amount of money spent by a household. Thus, the article is saying that for countries where households spe
6.
by obastani 2y ago
This is exactly the problem we have found in our research on generative AI for education [1]. We ran a pilot in a large high school in collaboration with math teachers, and found that students basically copy answers from ChatGPT, resulting
7.
Generative AI Can Harm Learning(papers.ssrn.com)
4 points by obastani 2y ago|0 comments
8.
by obastani 3y ago
This breaks down because it's not easy to statically reason about when a variable is a NonZeroNumber. For example, what is the type signature for subtraction of two NonZeroNumbers? You can't guarantee that it isn't zero, so i
9.
by obastani 3y ago
Important caveat with some of the results: they are using better prompting techniques for Gemini vs GPT-4, including their top line result on MMLU (CoT@32 vs top-5). But, they do have better results on zero-shot prompting below, e.g., on Hu
10.
by obastani 3y ago
> So, the 2% growth rate for world energy consumption should be a conservative assumption. An important caveat: this article assumes that energy consumption will continue to increase exponentially to get the 1000 year timeline of drainin
11.
by obastani 3y ago
I don’t really understand the argument that corporate profits are driving inflation. If demand for a product goes up, we would naturally expect prices to rise since there is more competition for a fixed set of goods. Since the cost of produ
12.
by obastani 4y ago
Just out of curiosity, in what sense is Codex is better trained than CodeGen?
13.
by obastani 4y ago
I’m not sure I buy the conclusion. The point in the original story (at least the version I’ve read) was that Mel’s main job was to write code that could make the computer appear as fast as possible to potential customers. Of course one hack
14.
by obastani 4y ago
I'm not sure about that. If Mary knows all the physics of light, she can design and set up a sensor to detect the color of the apple and the instructions, just like we have sensors that detect ultraviolet and infrared light. Just as we
15.
by obastani 4y ago
One important caveat is that in the study, as far as I can tell, the money is coming from a different country (presumably the USA) than the target country (Kenya), so there is a baseline effect of increasing the net wealth of Kenya. If the
16.
by obastani 4y ago
Uniformly random data means that someone’s perception of their ability is uncorrelated with their actual ability, which is exactly what DK=true is saying!
17.
by obastani 4y ago
I feel like this article is severely over-complicating the analysis. Looking at the original blog post [1], their key claim appears to be that "random data produces the same curves as the DK effect, so the DK effect is a statistical ar
18.
Efficient and targeted Covid-19 border testing via reinforcement learning(nature.com)
1 points by obastani 5y ago|0 comments
19.
by obastani 5y ago
As far as I know, Konrad Zuse didn't prove that this strategy was a universal model of computation. In contrast, Turing proved that his universal machine could emulate any other machine, given the right program. In my view, Turing&#x27
20.
by obastani 5y ago
I'm not sure what the author has in mind, but a standard way to put a topology on this space would be to use the discrete topology [1] on {0, 1}, and then use the product topology [2] to obtain a topology over the space of binary strea
21.
by obastani 5y ago
There has been some interesting recent work [1] applying Fourier transforms (more precisely, an adaptation of the Fourier transform to the sphere) to CNNs, to automatically encode equivariance to rotational symmetries. [1] https:/&#x2
22.
by obastani 5y ago
There is a subtle but important difference. To be more precise, consider the following two statements: 1) There exists some n such that all integers >= n satisfy the desired property. 2) For n = [a specific constant], all integers >=
23.
by obastani 5y ago
I don't think that's quite right. There are two possible precise statements for such claims: 1) There exists some n such that all integers >= n satisfy the desired property. 2) For n = [a specific constant], all integers >=
24.
by obastani 6y ago
But, humans can currently learn to teleoperate robots (e.g., surgical robots) much better than AI. So, they are dealing with the same hardware, and it is hardware a priori unfamiliar to the human. Thus, at least in these cases, the differen
25.
by obastani 6y ago
One thing to keep in mind is that there are way more people alive today than ever before. According to Google, there have been about 108 billion humans alive, and 7.7 of those are alive today. So, your chances of living during the "mos
26.
by obastani 6y ago
According to Wikipedia [1], the transistor was independently rediscovered by two German physicists just a year later (1948). [1] https://en.wikipedia.org/wiki/Transistor#History
27.
by obastani 6y ago
This is not quite correct. The log probabilities are log p(y=1 | x; beta) = beta * x - log Z(x; beta) where Z(x) = p(y=0 | x; beta) + p(y=1 | x; beta) Thus, you can think of it as linear regression, but with an additional term log Z(x; beta
28.
by obastani 6y ago
Not an answer to your question, but the Sagrada Famila [1] began construction in 1882, and is projected to be completed around 2030. It's an immense (and beautiful) structure. Just want to point out that it's not just a matter of
29.
by obastani 6y ago
This statistic is very hard to interpret without additional context. If 99% of people stay at home, the of course most people who get infected would have stayed at home. Older people, who are more likely to need hospitalization, are also mo
30.
by obastani 6y ago
This is a good point, but an even more basic issue is that the question "what is a number" is a matter of definition. There isn't a "correct" definition of numbers; only one that we've accepted as standard. The

More ›