enjeyw

10 ms·

1.
by enjeyw 2mo ago
The author hints at this but it seems like one issues is that while JEPA is good at distinguishing between unpredictable noise and predictable features, the model has no way of assigning importance to different predictable features. So for
2.
by enjeyw 3mo ago
I think that’s a false dichotomy. My Lazer Genesis Helmet is a MIPs and it’s the lightest helmet Lazer made at the time. Much more breathable than my previous helmets too.
3.
by enjeyw 5mo ago
The story of the navigator in the photo is also worth a read [1]. Very reminiscent of Joseph Heller’s work. 1. https://www.rbogash.com/B-52/Carls_Letter.html
4.
by enjeyw 5mo ago
Yeah I did wonder myself if that tweet was an admission of guilt. If I were a lawyer responsible for defending Trump in the Hague, I'd argue that the tweet was actually an abbreviated way of saying "If Iran does not comply, we wil
5.
by enjeyw 5mo ago
What I find tricky to reason about here is that whether destroying infrastructure comes down to "whether the military advantage outweighs the impact to civilians", and as far as I can tell, there's no robust way to assess thi
6.
by enjeyw 7mo ago
Ok I’ll bite… 37 miles?!? Why??
7.
by enjeyw 8mo ago
One of the big problems with Attention Mechanisms is that the Query needs to look over every single key, which for long contexts becomes very expensive. A little side project I've been working on is to train a model that sits on top of
8.
by enjeyw 8mo ago
Oh I didn’t know that! Thanks for the clarification.
9.
by enjeyw 8mo ago
Well markets are evaluated on a number of different metrics depending on what you’re trying to determine. If you want to go be pedantic about it and select one metric, markets are evaluated on their Brier Score or some other Proper Scoring
10.
by enjeyw 8mo ago
It absolutely has been! In general prediction markets can’t be “correct” or “incorrect” - for instance if a prediction market says there’s a 60% chance of an event occurring, and it doesn’t occur, was the market right or wrong? Well it’s ha
11.
by enjeyw 9mo ago
I used to share a somewhat similar sentiment. I know one anecdote is not data, but his investment in BYD all the way back in 2008 does counter that viewpoint somewhat - his investment success in the BYD case isn’t from other investors follo
12.
by enjeyw 9mo ago
Overly specific LLM research into KV cache eviction. The vast majority of tokens in a sequence will be irrelevant to an attention mechanism outside of a very small window. Right now however we tend to either keep all cache values forever, o
13.
by enjeyw 10mo ago
I made a tool for this! It's an essay writing platform that tracks the edits and keystrokes rather than the final output, so its AI detection accuracy is _much_ higher than other tools: https://collie.ink/
14.
by enjeyw 10mo ago
I've been exploring this concept in LLMs for the last week or so, to see if I can RL train one into being inherently curious. I haven't got any beyond my own working notes and some basic plots, but I've unceremoniously dumped
15.
by enjeyw 1y ago
Yeah, I've often found that getting everyone pulling in the same direction is much more important than what the direction actually is. If lots of smart people have thought about something and still disagree on the correct approach, pic
16.
Be Wary of Compromise(thealephengine.substack.com)
4 points by enjeyw 1y ago|2 comments
17.
by enjeyw 1y ago
I mean I kind of get it - overgeneralising (and projecting my own feelings), but I think HN favours introducing and discussing foundational concepts over things that are closer to memorising/wrote-learning. I think AI Math vs Leetcode
18.
by enjeyw 1y ago
My bad; Missed the sarcasm!
19.
by enjeyw 1y ago
Yeah on re-read I think you’re right. Though who knows in this day and age!
20.
by enjeyw 1y ago
I have no reasonable theory as to how Trump/RFK will be able to reveal credible information about Autism that wasn’t already available from public research papers.
21.
by enjeyw 1y ago
About 10 years ago I became more aware that reducing my consumption of meat was good for the world. The was good for Beyond Meat’s prospects. About 5 years ago I became more aware that reducing my consumption of ultra processed food was goo
22.
by enjeyw 1y ago
I made a text editor that detects whether something has been AI generated by analyzing the keystrokes and edit history: www.collie.ink Haven’t really told anyone about it so no one is using it, but I think it’s a good idea!
23.
Agile Is (Half) Dead(thealephengine.substack.com)
3 points by enjeyw 1y ago|0 comments
24.
by enjeyw 1y ago
Lol! Technically they're not wrong about it being AI generated, just not at all in the way they meant.
25.
by enjeyw 1y ago
Yeah this is something I'm a little worried about - right now it's not extremely difficult to just take an AI generated essay and then just tweak the essay until it passes. My first pass approximation is to make the assessment of
26.
by enjeyw 1y ago
Yeah it's a good call out. I think it's a (more) winnable battle though. For both a keystroke based AI detector, and software designed to mimic human keystroke patterns, performance will be determined by the size of the dataset th
27.
by enjeyw 1y ago
I'm building Collie ( https://collie.ink/ ). It's a tool to help teachers detect student assignments that have been written by AI. Unlike other solutions out there, it's an entire web-based text editor that ana
28.
by enjeyw 1y ago
Side note to dang: Please don’t delete this thread. Yes it’s getting pretty heated, but it’s by far the most rational discussion of this topic I’ve seen in a while. Plus I’ve learnt a few things, which tends to be a positive signal for qua
29.
by enjeyw 1y ago
It feels to me that even ignoring copyright law, Kastel has a limited claim to the credit here. Art director Alex Gotfryd came up with the concept of the Shark and the Swimmer, while Paul Bacon did the original drawing. At this point what’s
30.
by enjeyw 1y ago
Hahaha yeah won’t dispute that!

More ›