frogamel

5 ms·

1.
by frogamel 3y ago
The research in this space is very conflicting about what methods actually work. In the graph on the page, the ETS model (basically just a weighted moving average) outperforms multiple, recent deep learning models. But the papers for those
2.
by frogamel 3y ago
I've worked in many research scientist/MLE roles over the years and I haven't met any IC who has this much of a fixation on AI being a moral evil/good. The ones who do are inevitably nontechnical hucksters, usually just
3.
by frogamel 3y ago
I might be miunderstanding something here, but what complexity here is resolved by making this a framework? Isnt this just: 1. Train model like normal 2. Evaluate model using self 3. Use eval results for DPO finetune
4.
by frogamel 3y ago
IMO if you're going to profit off open research, you should at least make your own work available for other researchers. The white paper has 10 pages of performance benchmarks but 5 sentences on methodology.
5.
by frogamel 3y ago
Exactly one state has! https://en.wikipedia.org/wiki/Bank_of_North_Dakota It's state-owned but functions as a typical retail bank that takes deposits, makes mortgages, business loans, etc.
6.
by frogamel 3y ago
Dplyr actually supports some really cool join functionalities that I wish were in SQL implementations, including: - Ability to specify whether your join should be one-to-one, many-to-one, etc. So that R will throw an error instead of quietl
7.
by frogamel 3y ago
I know many people who've gotten big raises over the last 2-3 years, including individuals who have more than doubled their pay. And they always attribute their raises to hard work, job hopping, or climbing the promotion ladder. At the
8.
by frogamel 3y ago
Every tech company minus the few doing core research have been doing this for at least half a year. Generate training data with GPT4 or sometimes even 3.5 -> use it to do a QLoRA finetune on a llama or mistral base -> roll it out as a
9.
by frogamel 3y ago
I've noticed a huge surge in negativity and pessimism on English-language social media within the last year or so, roughly corresponding with to the spread of LLM tech. I do wonder whether these people are mostly just bots.
10.
by frogamel 3y ago
I dont think the first part of this article is quite right. 1. I doubt many people would think of 9/11 as a "1 in 50 years" event if it didn't actually happen. If you had a year-by-country level dataset of every develope
11.
by frogamel 3y ago
In my experience, you can get extremely good performance in this style of sports prediction with extremely basic methods. E.g. doing some sort of basic Elo rating system + choosing the higher rated competitor to win every game. This is simp
12.
by frogamel 3y ago
Honestly shocking that they would lay off a guy whose had this much of an influence on data science tooling generally. Every company I've worked at has had a sizable proportion of the analytics team using knitr+rmd. I hope this does no
13.
by frogamel 3y ago
I must be missing something here. I used to work on a voice assistant product and everything demoed is pretty bog standard stuff: play music, shop, order food, get Uber rides, ask random queries, recognize images. This also runs into the sa
14.
by frogamel 3y ago
A few months ago I tried migrating a large pandas codebase to polars. I'm not much of a fan of doing analytics/data pipelining in Python - a complex transformation takes me 2-5x as long in pandas compared to Julia or R (using data
15.
by frogamel 3y ago
I think companies in this "data analytics platform but with LLM integration" space are going to struggle in the next few years. The pain points of analytics are completely different than traditional software engineering, and thing
16.
by frogamel 3y ago
Many of the recent articles in the media about productivity are inaccurate, there is a big difference between plain English "productivity" and the economic concept of productivity. The quoted productivity #s are aggregates measure
17.
by frogamel 3y ago
This is a really interesting perspective, and made me consider what pushed me to inflate my own prices (my salary) especially aggressively the last few years. In 2020-2022 my input costs (housing, food) went up ~20%, so I also needed to inc