tarvaina

5 ms·

1.
by tarvaina 1mo ago
I came here to quote the same sentence. Here's another way to look at it: Suppose there actually is a best word choice. The LLM doesn't know what it is but makes a guess. Maybe it's the best one, maybe it isn't. The prob
2.
by tarvaina 3mo ago
The main linked article actually does not have that video; the article linked from in the description does have it. Not surprising that someone missed it.
3.
by tarvaina 5mo ago
I live nearby and really enjoy Oodi. It's usually much busier than in these pictures.
4.
by tarvaina 1y ago
Nitpick: The early moves in the game are called fuseki. Joseki refers to well-studied local patterns of moves and they appear through the middle game, not just in the early game. A couple of things I love about go is that you don't nee
5.
by tarvaina 1y ago
The Wikipedia article says: "Rock, sand and concrete has a heat capacity about one third of water's. On the other hand, concrete can be heated to much higher temperatures (1200 °C) by for example electrical heating and therefore h
6.
by tarvaina 1y ago
(Off topic.) Not only that, but Linus's parents were politically active communists and young Linus was a pioneer (like a boy scout but for communists). His father also lived in Moscow for several years on two separate occasions.
7.
by tarvaina 1y ago
_Miles_ from the ocean? Budapest is 620 miles from the nearest ocean at the mouth of Elbe. (Incidentally exactly 1000 km.)
8.
by tarvaina 1y ago
You are absolutely right, I cannot see it there either! Sorry for the misdirection.
9.
by tarvaina 1y ago
You can turn them on in the workspace admin settings: https://help.openai.com/en/articles/11954883-legacy-model-ac...
10.
by tarvaina 1y ago
It took me a while but I think the difference between Vertex and Gemini APIs is that Vertex is meant for existing GCP users and Gemini API for everyone else. If you are already using GCP then Vertex API works like everything else there. If
11.
by tarvaina 1y ago
Yeah. Alternative explanation: I'd say 3 and 7 are out because they often come up in fairy takes etc as magical. 5 is out because it's half of ten and the number of fingers. 2 is out because it is too small.
12.
by tarvaina 1y ago
Oh, right! I forgot about it. I guess 8 would do too.
13.
by tarvaina 1y ago
Also it is one party (The Finns) presenting a rail initiative competing with their government partner's (National Coalition) older initiative. It is very unlikely that they both will be implemented.
14.
by tarvaina 1y ago
Stray thought: Why 4 and 9? Because the joke is funniest if the number is completely ordinary. 0 and 1 are special and so are all prime numbers. 6 is out because it's the maximum die throw. And one figure is more ordinary than two figu
15.
by tarvaina 1y ago
The article is about choosing 12 colors from the 4096-color palette.
16.
by tarvaina 1y ago
There are actually six different TV series: 1959: https://en.wikipedia.org/wiki/Die_Muminfamilie 1969: https://en.wikipedia.org/wiki/Moomin_(1969_TV_series) 1972: https://en.wikipedia.o
17.
by tarvaina 1y ago
This is how Clojure does it. https://clojure.org/guides/learn/hashed_colls#_creating_a_li...
18.
by tarvaina 2y ago
Website of the actual event: https://www.the-final-experiment.com/
19.
by tarvaina 2y ago
Isn't white vs blue collar a latent variable? You have to operationalize it somehow. If you just ask "how blue collar are you?", people's answers will be influenced by all kinds of subjective biases. I'd argue sitte
20.
by tarvaina 2y ago
As a Finnish speaker I've often wondered about this. In Finnish (and Hungarian) the stress is almost always on the first syllable, so it is easy for speakers to distinguish word boundaries. How do speakers of other languages do it? Now
21.
by tarvaina 3y ago
Did I get this right? Bard – old name of their generative AI service, to be called Gemini Duet AI – old name for their generative AI in Google Workspace, to be called Gemini Gemini – three things: 1. the name of their models (like GPT). 2.
22.
by tarvaina 3y ago
We got access soon after the API was announced and have happily been using Claude Instant in production for a couple of months now. It may have helped that our use case was a good match for their capabilities.
23.
by tarvaina 3y ago
Suppose we have trained a model to perform a certain set of tasks. Later we would want to teach it a new task. Catastrophic forgetting means that teaching it a new task makes it unlearn some or all of its earlier tasks. It occurs because tr
24.
by tarvaina 3y ago
For questions such as the difference between typhoon and hurricane, ChatGPT and Claude give accurate answers in just a couple of seconds. It’s such a different experience compared to the search engines.
25.
by tarvaina 3y ago
The impossibility of a general lossless compression algorithm is a consequence of the pigeon-hole principle. https://en.m.wikipedia.org/wiki/Pigeonhole_principle
26.
by tarvaina 3y ago
I would guess max_tokens refers to the number of generated tokens, not the size of the context window. That at least is the meaning of max_tokens in the ChatGPT API. https://platform.openai.com/docs/api-reference/c
27.
by tarvaina 3y ago
Based on the NPR article you linked this sounds like a normal scientific debate, though? One researcher says that data supports their theory, another says that it doesn't if you look at the data more carefully. I don't see accusat
28.
by tarvaina 3y ago
The ingredients you need for training a useful machine learning model are expressivity, learnability, and generalization. Many methods are universal approximators but that only takes care of the first ingredient. Arguably the reason neural
29.
by tarvaina 3y ago
Tensorflow is also from Google Brain, not DeepMind.
30.
by tarvaina 3y ago
Not all transformers have separate encoders and decoders. GPTs, for instance, only have the equivalents of decoder layers of the original transformer paper, but they are still considered transformers. Karpathy’s video shows an actual GPT-st

More ›