JoshCole

6 ms·

1.
by JoshCole 5mo ago
That is part of why https://mieza.ai/ is giving a grounding layer that is backed by game theory. Actions have consequences. Tracking decisions and their consequences is important. One thing that becomes very clear from th
2.
by JoshCole 5mo ago
> Can you talk more about why you chose CLJ for datascience / ML. I use Python for a lot of machine learning. My vision transformers, for example, are in Python. There is a lot to like about the Python ecosystem. Throwing away li
3.
by JoshCole 5mo ago
I know others already pointed out a ton of things, but having worked with Clojure in 2016 and doing active Clojure development for my startup now I feel like I have to chime in too. In 2016, Clojure was not great for serious data science.
4.
by JoshCole 6mo ago
I've been obsessed with game theory for years. Started by reimplementing papers, got annoyed at how bad the tooling was, wrote my own, and somewhere along the way realized the field's core assumptions about competition are wrong.
5.
by JoshCole 10mo ago
It is pleasantly sensible since servant leadership in a sense creates an innocence because of the incents; the underlying reality is that wisdom dwells with prudence. Principles of revelation arise from incentive compatibility. Aiming at
6.
by JoshCole 1y ago
Very cool work Jan! Have you tried experimenting with ham-fisted? I've found the libraries in the techascent part of the Clojure ecosystem to be very good performance wise. Ditto for neanderthal.
7.
by JoshCole 1y ago
Lisps (like Clojure) treat code as data (lists), so you write: `(if x (y) (z))` instead of Python’s `y() if x else z()`. So the code is more concise, but does less to walk a novice through it. This gains a huge advantage, which allows even
8.
by JoshCole 1y ago
> We are now getting an equivalent definition of what neural nets are being trained for! LLMs are trained to compress the internet as much as possible! Nice payoff. Others have also called out the relationship to compression ( https:&#x
9.
by JoshCole 1y ago
Chess engines cannot see like a human can. When they think they don't necessarily think using the exact same method that a human uses. Yet train a chess engine for a very long time and it can actually end up understanding chess better
10.
by JoshCole 1y ago
You're doing this thing again where you say tons of things that aren't true. > An LLM only learns through input text. This is false. There already exist LLM which understand more than just text. Relevant search term: multi-mo
11.
by JoshCole 1y ago
I don't find it reasonable that you didn't understand my corrections, because current AI already do. So I'm exiting the conversation. https://chatgpt.com/share/683a3c88-62a8-8008-92ef-df16ce2e8a...
12.
by JoshCole 1y ago
For an example of a reward model that doesn't include "C" explicitly consider a reward model defined to be the count of the one bits in letters in the input. It would define a reward for "C" but "C" doesn
13.
by JoshCole 1y ago
> But doesn't reward for "*C" means that "C" is in the training data? You're running into an issue here due to overloading terms. Training data has three different meanings in this conversation depending on
14.
by JoshCole 1y ago
In reinforcement learning and related fields, a _reward model_ is a function that assigns a scalar value (a reward) to a given state, representing how desirable it is. You're at liberty to have compound states: for an example, a traje
15.
by JoshCole 1y ago
> Only if you create new reward models for C, the output for D will improve, and so on. Again, tons of false claims. One is that 'you' have to create the reward model. Another that it has to be human-curated at all. Yet anot
16.
by JoshCole 1y ago
> dependent on human curated reward models to score the output to make it usable. This is a false premise, because there already exist systems, currently deployed, which are not dependent on human-curated reward models. Refutations of yo
17.
by JoshCole 1y ago
> it can't "think" of something entirety conceptionally new, because it doesn't really "think". Hierarchical optimization (fast global + slow local) is a precise, implementable notion of "thinking.&quot
18.
by JoshCole 1y ago
They don't claim that. They say LLMs only generate text someone has written. Another way you could refute their premise was by showing the existence of AI-created programs for which someone isn't a valid description of the writer
19.
by JoshCole 1y ago
> LLMs can only give you code that somebody has wrote before. This premise is false. It is fundamentally equivalent to the claim that a language model being trained on a dataset: ["ABA", "ABB"] would be unable to gene
20.
by JoshCole 2y ago
> Congress hasn't approved DOGE. In 2014, under Obama, the United States Digital Service was established with by Congressional appropriations with the mission to "deliver better government services to the American people throug
21.
by JoshCole 2y ago
Competent companies tend to put a lot of effort into building data analysis tools. There will often be A/B or QRT frameworks in place allowing deployment of two models, for example, the new deep learning model, and the old rule based
22.
by JoshCole 3y ago
The article claims as part of its argument that AI has not had algorithmic advances since the 80s. This is an exceedingly false premise and a common misconception among the ignorant. It would actually be fairer to say that every aspect of
23.
by JoshCole 3y ago
From the Hacker News guidelines: > Be kind. Don't be snarky. Converse curiously; don't cross-examine. Edit out swipes. > Comments should get more thoughtful and substantive, not less, as a topic gets more divisive. > When
24.
by JoshCole 3y ago
As laymen definitions are incoherent nonsense derived from fiction, the popular culture definition of AI isn't a reasonable substitute for the theory-laden definitions. The four definitions given in Artificial Intelligence: A Modern A
25.
by JoshCole 3y ago
> LLMs do not constitute "AI" let alone the more rigorous AGI. I have a textbook, "Artificial Intelligence: A Modern Approach," which covers Language Models in Chapter 23 (page 824) and the Transformer architecture in
26.
by JoshCole 3y ago
I've been in a self-driving Tesla vehicle. After hours on the interstate, the person ahead of me slammed on their brakes suddenly. I was caught off guard, not expecting it, and may have crashed by not reacting in time. The Tesla bra
27.
by JoshCole 3y ago
Here is my point through the filter of ChatGPT asked to state it nicely. I'm sorry if it comes off as a rude. If you propose a theory that suggests overconfident individuals are taking reckless actions, compromising safety, it's
28.
by JoshCole 3y ago
The practical impact of the change you call stupid and reckless was that the car stopped slamming its brakes when going under underpasses. So when it comes down to it what you are claiming is that it is stupid and reckless to decide not to
29.
by JoshCole 3y ago
It is hindsight bias. You are explaining the observed safety record of Tesla being on top for safety by appealing to them being inferior and reckless. You are explaining Tesla causing a greater reduction in accident death than Waymo by the
30.
by JoshCole 3y ago
He is talking about the long technical talk at CVPR. https://www.youtube.com/watch?v=g6bOwQdCJrc For example look at this section: https://youtu.be/g6bOwQdCJrc?t=1370 Also if you look into it you will find

More ›