redlock

5 ms·

1.
by redlock 9mo ago
I hope this isn't Opus 4.5
2.
by redlock 9mo ago
Not true anymore since Gemini 2.5 pro I have quizzed it with three books (total more than 1500 pages) and it gave great answers. Initially yes when they released 2 million context with Gemini 1.5 it wasn’t effective. Try it with Gemini 3 pr
3.
by redlock 9mo ago
“But clearly the difference between LLMs in 2025 and 2023 is not as large as between 2023 and 2021.” This is a ridiculous statement. A simple example of the huge difference is context size. GPT-4 was, what, 8K? Now we’re in the millions wit
4.
by redlock 1y ago
Easier to debug deterministic inference
5.
by redlock 1y ago
Nope https://x.com/polynoamial/status/1946478249187377206?s=46&t=...
6.
by redlock 1y ago
Really? Mansplain? Why bring gender wars terms into this.
7.
by redlock 1y ago
Doesn't OpenRouter ranking include pricing? Not really a good measure of quality or performance but of cost effectiveness
8.
by redlock 1y ago
I wouldn't call the inflation that ravaged the world and real estate prices beyond the means of the middle class "saving". His quantitative easing and zero interest rate policy only saved asset managers and corporate balance
9.
by redlock 1y ago
Noam Shazeer is not any guy. And I would bet the latest jump in Gemini capability is a result of him coming back.
10.
by redlock 2y ago
This is my observation as well. Recent market gains doesn't reflect how inflation eroded most people purchasing power. People today are worse off than before Covid even though the market is much higher. Debt fueled growth (through quan
11.
by redlock 2y ago
Moore's law is exponential
12.
New deepseek paper: Natively Trainable Sparse Attention mechanism(twitter.com)
5 points by redlock 2y ago|1 comments
13.
by redlock 2y ago
Parent poster did say they are aware they don’t know but can’t express it. I am guessing he is referring to mechanistic interpretability research like these: https://arxiv.org/abs/2405.16908 https://arxiv.or
14.
by redlock 2y ago
The issue here is that, even with a lot of VRAM, you may be able to run the model, but with a large context, it will still be too slow. (For example, running LLaMA 70B with a 30k+ context prompt takes minutes to process.)
15.
by redlock 2y ago
What did he do with the dumb and energetic?
16.
by redlock 2y ago
He was always athletic. I believe he was captain of the fencing team in high school.
17.
by redlock 2y ago
Do we know how human understanding works? It could be just statistical mapping as you have framed it. You can’t say llms don’t understand when you don’t have a measurable definition for understanding. Also, humans hallucinate/confabula
18.
by redlock 2y ago
Until it killed him (ignoring doctors advice on cancer)
19.
by redlock 2y ago
What does loom have anything to do with AI? It is a nifty way to share video recordings easily and quickly. In that they did a great job
20.
by redlock 2y ago
I don't care much for the concept of AGI since it's ill defined. However, out of distribution generation and generalization are a better more useful metric. In these Yann Lecun has argued that interpolation is meaningless in the
21.
by redlock 2y ago
They do make compelling arguments if you listened to them. Also, from my coding with llms using cursor they obviously understand the code and my request more often than not. Mechanistic interpretability research shows evidence of concepts b
22.
by redlock 2y ago
Because it isn't true according to Hinton, Sutskever, and other leading AI researchers.
23.
by redlock 2y ago
So Eniac was a dead end? Or you believe that the cost won't go down for some reason?
24.
by redlock 6y ago
https://physics.stackexchange.com/questions/15282/quantum-en... And here is some experimental data http://arxiv.org/pdf/1303.0614v1.pdf
25.
by redlock 6y ago
By refusing to follow the rules set by the medical authorities. Refusing to wear mask, not isolating when infected, etc... A more extreme example of false beliefs causing great harm is the Holocaust that was caused by Nazis believing the Je
26.
by redlock 6y ago
Isn’t cause and effect mediated by forces that travel at the speed of light? Simultaneous events cannot be in a causal relationship, no?
27.
by redlock 6y ago
I wish I could get a clear explanation of why faster than light travel breaks causality. I have seen the math but intuitively I am having trouble grasping it especially when you have only two reference frames (most explanations will use thr
28.
by redlock 7y ago
This is very ignorant. Norway’s model was taken from Kuwait ( https://en.m.wikipedia.org/wiki/Kuwait_Investment_Authority ) It isn’t a coincidence that an Iraqi advised them. He saw the model in Kuwait.