martingalex2

6 ms·

1.
by martingalex2 4mo ago
It's the only way he could get more tokens beyond the Max 20x plan lol.
2.
by martingalex2 11mo ago
Isn't the point that now Andrej's published this, it will be in-distribution soon?
3.
by martingalex2 11mo ago
That's a very provocative last point, but I suppose we are living in an unwitting experiment.
4.
It's the Internet, Stupid. What caused the global populist wave?(persuasion.community)
9 points by martingalex2 11mo ago|3 comments
5.
by martingalex2 1y ago
Assuming this observation applies generally, give one point to the embodiment crowd.
6.
by martingalex2 1y ago
My prior is that if Daron Acemoglu thinks the impact of Gen AI on productivity is muted, then it's probably a good unbiased gauge.
7.
Word Tour: One-Dimensional Word Embeddings via the Traveling Salesman Problem(data-processing.club)
3 points by martingalex2 1y ago|0 comments
8.
by martingalex2 1y ago
This seems like an extreme of example of "all models are wrong, but some are useful".
9.
by martingalex2 2y ago
Yes why are these not published in a nice book? I would love to read these too!
10.
by martingalex2 2y ago
Need more data.
11.
LLM as an n-dimensional Object in n-dimensional Space(medium.com)
9 points by martingalex2 2y ago|0 comments
12.
by martingalex2 2y ago
from the article "A pattern we see in some interpretability and interpretability-adjacent ML papers is defining some metric which is claimed to correspond to some property of interest, and then very rigorously measuring this metric. We
13.
Reflections on Qualitative Research(transformer-circuits.pub)
54 points by martingalex2 2y ago|3 comments
14.
by martingalex2 2y ago
[deleted]
15.
by martingalex2 2y ago
This is a good overview https://www.akingump.com/en/insights/alerts/commerce-issues-...
16.
by martingalex2 3y ago
I think people will continue to value human-made paintings much like we still value human-played chess games.
17.
Escape from Model Land – book review(blogs.lse.ac.uk)
2 points by martingalex2 3y ago|1 comments
18.
by martingalex2 3y ago
In Escape from Model Land: How Mathematical Models Can Lead Us Astray and What We Can Do about It, Erica Thompson explores how mathematical models are used in contexts that affect our everyday lives – from finance to climate change to healt
19.
by martingalex2 3y ago
the people you're supposed to be eliciting requirements from are just regurgitating what ChatGPT told them are the requirements hehehe
20.
by martingalex2 3y ago
I'm interested in whether this has potential trickle effect in other startups where the staff threaten to mutiny if they don't like the change in leadership. Flipping crazy and precedent setting for corporate governance.
21.
Pretraining on the Test Set Is All You Need(arxiv.org)
4 points by martingalex2 3y ago|0 comments
22.
by martingalex2 3y ago
power laws
23.
Empty spaces and hybrid places: The pandemic’s lasting impact on real estate(mckinsey.com)
1 points by martingalex2 3y ago|0 comments
24.
by martingalex2 3y ago
Why isn't GPT4 running the company and handling these marketing missteps? j/k
25.
by martingalex2 3y ago
Who is the carpetbagger?
26.
by martingalex2 3y ago
What is the hard technical barrier that makes the tracking of attribution for input sequences for LLM training impossible? I don't see any.
27.
by martingalex2 3y ago
Yes it’s just an engineering problem, there is no a priori reason not to do it.
28.
by martingalex2 3y ago
It isn’t clear to me (other than it’s an open engineering problem) why LLs couldn’t also include attribution as part of training. Also tracking attribution could lead to some insights on how its internal representations in vector space are
29.
by martingalex2 3y ago
This is a very intriguing study as it would appear the fact that LLMs need public data to train on, its incentive on the marketplace of ideas is to reduce the very thing that gives it its power. It contains the seeds of its own destruction,
30.
by martingalex2 3y ago
I'd love to get an AI philosopher to address the interesting thought experiment here. I think this really needs to get at the truth - paraphrasing Stephen Wolfram - of whether language is actually much simpler than we've all assum

More ›