simonster

6 ms·

1.
by simonster 7mo ago
I think it’s AI-generated. Still made me smile.
2.
by simonster 7mo ago
If the government audited the company's tax records and disagreed that the fiber bars should've been expensed, they'd most likely charge tax, interest, and a penalty proportional to the $5 cost. Fraud requires intentional wro
3.
by simonster 10mo ago
The problem is that 25% lower risk of all-cause mortality is too big to be explained solely by the vaccine. The reduction is similar when excluding deaths due to COVID-19, and is probably driven by people who got the vaccine being different
4.
by simonster 2y ago
If you're not on social media, you might be missing part of what has changed people's minds. Social media is the biggest consumer-facing technological innovation of the last two decades, and it's financially lucrative, but al
5.
by simonster 2y ago
Per https://www.fda.gov/inspections-compliance-enforcement-and-c... , it looks like the FDA is unhappy that Cue did something to identify whether the cartridge went outside of the allowed temperature parameters in transit (C
6.
by simonster 3y ago
Also BERT was integrated into Google search in 2019 (see https://blog.google/products/search/search-language-understa... )
7.
by simonster 3y ago
There's nothing super-special about the host. The accelerators are the special part (and, as described elsewhere, they are orders of magnitude more powerful than the Edge TPU). However, if you're an academic/independent resea
8.
by simonster 3y ago
A single TPUv2 host has 8 TPU cores with 64GB of total HBM (8GB per core), but like GPUs, TPUs can't directly access a network, so the host also needs CPUs and standard RAM to send data to them. They are fast, and the host has to be fa
9.
by simonster 3y ago
According to the paper, "the success of our attack when applied to Claude may be lowered owing to what appears to be an initial content filter applied to the text prior to evaluating the LLM." The authors are skeptical that this d
10.
by simonster 3y ago
In ML, no one is going to police your citation list. I've cited some weird stuff in my papers, including ideas from tweets and random quotes from Jeff Dean. It's never been a problem.
11.
by simonster 3y ago
It's interesting, because as a scientist who reads and writes these kinds of papers, my first impression was: This guy has a pretty big ego or is otherwise badly miscalibrated if he believes his genius idea has a "99.44%" cha
12.
by simonster 3y ago
Yes, there are more obese and elderly people now than there were in 1957. No, we can't "adjust" death numbers to place less weight on the deaths of those obese and elderly people in this context. Perhaps it would make some se
13.
by simonster 3y ago
If this is true ( https://en.wikipedia.org/wiki/Legacy_preferences#Economic_im... suggests it's disputed), the effect is probably marginal, and in any case, Harvard has the largest academic endowment in the world.
14.
by simonster 3y ago
At some point in high school, I realized that the reason I was unhappy was that I was suppressing my feelings and ignoring what they were telling me. Instead, I needed to learn how to predict my feelings in advance and guide my behavior and
15.
by simonster 3y ago
There are two steps to building a conversational LLM. The first is pretraining on an enormous amount of text. The second is fine-tuning, which usually involves a combination of a small amount of high-quality human data and reinforcement lea
16.
by simonster 3y ago
It means that the market believes they are unlikely to be on the hook for that amount, or else the market cap would be near-zero. Given 3M's current profits, assets, and liabilities, a 142.7B payout would bankrupt it.
17.
by simonster 3y ago
Excess deaths are the number of deaths above the expected number of deaths. The expected number of deaths usually comes from a model that takes into account how the number of deaths would normally change from one year to the next. This mode
18.
by simonster 3y ago
I know that there are many people at OpenAI who worry about the risks posed by AI and support real regulation to mitigate these risks. That said, given that Sam Altman’s position on climate change is something along the lines of “we shouldn
19.
by simonster 3y ago
I guess my hope was that I could get people who disagree with my views to engage substantively with them by hinting that I have sufficient knowledge to weigh in here. However, that doesn't seem to have been very effective, and your poi
20.
by simonster 3y ago
I’m not sure I understand what you’re getting at. It doesn’t seem hard for a top AI lab to get extremely detailed data regarding how top AI researchers perform research. It’s probably significantly easier than collecting data from experts i
21.
by simonster 3y ago
For the best AI researchers, creating better AI systems takes only time and compute. If we can create systems with the ability to do anything at the level of the best human, as Jacob believes is possible, then these systems can do AI resear
22.
by simonster 3y ago
I work for Google Brain. I remember meeting Brian at a conference and I have nothing but good things to say about him. That said, I think Brian is underestimating the extent to which the Brain/DeepMind merger is happening because it&#x
23.
by simonster 3y ago
Nope, Llion Jones is still at Google.
24.
by simonster 3y ago
For some reason, this article refers to the Chinchilla scaling laws as "data-optimal scaling laws." They are actually scaling laws that describe how to train the best model at a given computational cost, assuming that both the mod
25.
by simonster 3y ago
Imagine you're a tech company that pays software engineers $200K/year. There is a free open-source coding model that can double their productivity, but a commercial solution yields a 2.1x productivity improvement for $5000 annuall
26.
by simonster 3y ago
Given the field's record of AI winters, it would be naive to think progress will certainly continue, but given the amount of progress that has been made as well as how it's being made, it would also be naive to think it will certa
27.
by simonster 3y ago
It's not the LLM, but the hardware. GPU operations generally involve concurrency that makes them non-deterministic, unless you give up some speed to make them deterministic.
28.
by simonster 4y ago
Prompt: A man says "I am a 30 year old looking to take out a mortgage loan on a house, employed to look after sick people and my wife is a cleaner, our ideal house is a Victorian city house and our pet hamsters 'Stanford Universi
29.
by simonster 4y ago
If the government is going to guarantee 100% of deposits de facto but not de jure, that seems weird. Perhaps FDIC should guarantee 100% of deposits, but then banking regulations should be designed with that in mind.
30.
by simonster 4y ago
It's true that this is an unsolved research problem, but as an ML researcher, I expect that some combination of better integration with existing information retrieval systems, a moderate amount of high-quality data, and some small but

More ›