6 ms·
This article is written by an LLM, by the way. ("Quietly" is... as Claude might put it... "often the quiet tell".)
by meowface 6d ago
This article is written by an LLM, by the way. ("Quietly" is... as Claude might put it... "often the quiet tell".)
- SirFatty 6d agoand silently.
- s08148692 6d agoAnd I read it by asking an LLM to summarise it
- bayindirh 6d agoCan you share me the summary? I'd like to read a LLM summary of your summary. Things are bit tight today.
- NotSuspicious 6d ago[flagged]
- scronkfinkle 6d agoI wanted you to be wrong, and to be able to make this an example of us over-reacting to certain trigger words created by AI, but unfortunately I just scanned the first couple paragraphs with pangram and it reported 100% AI, so you're probably correct. I get a funny feeling in my stomach over the idea that common and effective means of communication (i.e. it's not X it's Y) have become faux pas to use because of AI. I think it's something about these phrases being taken away from us more-so than the AI inventing them.
- mlinhares 6d agoThat’s not common and effective, it’s buzz feed style articles.
- zamadatix 6d agoPangram should be paying HNers for how often we pitch needing to use their product by name to believe things as obvious as "a long form news article cramming every AI trope it can fit from start to finish" being AI written. At this point I'm surprised when a news article isn't largely AI written, let alone one using the default tone! I don't even mind it as much as others seem to, it's just turning into more and more of a rarity for a news article to not be these last few years and so is now what sticks out.
- wrsh07 6d agoYou have to name pangram because the other ai detectors are quite bad
- dwedge 6d ago> Pangram should be paying HNers for how often we pitch needing to use their product by name I kind of assumed it is, given how it suddenly seemed to start getting namedropped in multiple comment threads. And it's often in response to someone saying content is obviously LLM (with examples) and the shill wedges pangram into the conversation "omg you're right, I didn't believe you but I checked this new product and wow it agreed with you" as though that adds anything to the discussion at all.
- arjie 6d agoI mention pangram because it’s good at what it does. Otherwise, people like to claim “That’s just how I’ve always written. I always say That’s the seam and the seam undercuts the other pillar. It’s not just correct, it’s also verified lol; it’s just how I speak” and it’s obvious bullshit. Depending on the politics of the poster, people will also support this kind of garbage, but it’s all drivel. The authors are so often dishonest that it’s hard to believe that the things they’re saying are anything but a random hallucination.
- wgd 6d agoPangram gets brought up a lot because if I read an article and think it's blatant AI slop and want to communicate that fact, a natural impulse is to provide some sort of objective corroboration rather than just asserting that I have superior taste and thus am able to tell. Also Pangram is basically the only AI detector that's actually put in the work to build an accurate classifier, so if you try to discuss AI writing detection without being specific that you mean Pangram you'll get half a dozen commenters screaming about how awful some of the snake-oil salesmen like GPTZero are.
- nicce 6d agoAll these "is this AI" checkers should be banned, as they never can reach 100% accuracy.
- wrsh07 6d agoThis is a truely bizarre claim. Imagine if one said: "Weather forecasts should be banned because they can never reach 100% accuracy"
- nicce 6d agoThey are completely different things with different consequences. Someone can point to the sky and prove that the sun is there.
- joshmoody24 5d agoYou're responding to a comment about weather forecasts, not current weather. Pointing to the sun is not a forecast.
- PunchTornado 6d agoImagine writing an article in 5 days. Working hard. Posting it online and then everyone says it is ai and laughs and dismisses it because a tool says it is AI.
- teiferer 6d agoThey are overrepresented in HN discussions for sure as there is an over-reliance on them that just aims to shut down discussions. Which is ironic since they are a tool folks are trusting blindly supposedly used to argue against tool use with blind trust.
- wrsh07 6d agoFwiw, I only did the first 300 words (signed into pangram) and it seemingly correctly noted that there were 2 (mostly) human-authored sentences in there What's wild to me is that: 1. People are responding to this article like it's hitting a nerve 2. In most Ubers you already don't talk to the driver (yellow cabs are higher variance in NYC). Doesn't seem like anything's being lost in that case. 3. There are enormous safety benefits to waymo, mobility benefits for youth (and elderly) that are afforded by this technology. It's not clear why people argue "Uber" is better than waymo. A few years ago there were arguments against Uber! (A technology which, again, provides a huge benefit, especially if you live in an area where people were previously expected to go out for drinks and then drive home) I think it's fair to point out real issues at these companies. But we should be clear-eyed about which technologies we want to accelerate vs slow down
- teiferer 6d agoHave you actually read the article? They point out multiple times that they like the Waymo ride and would use one again and loved it. It's not a Waymo-bashing article, it cautions against the long term effects on research. And here you have it — I used an LLM-ism. Oh, and now another one! Time to downvote me for supposed LLM use! (Which I obviously didn't, I'm typing this on an ancient smartphone waiting for a train, but that doesn't deter the witch hunters.)
- meowface 6d agoYou actually didn't. The construct is slightly different. I use LLMs all day every day. I think they're great. I just don't like humans who put their name to what an LLM did.
- teiferer 6d ago> You actually didn't. The construct is slightly different. Well I know that I did, so you are wrong with that claim, which sheds a strong (negative) light on other statements of fact that you posted in this discussion. You may disagree with me, or I may even have gotten something wrong, but just claiming I didn't read the article ... sorry man, I thought HN had higher standards than that.
- bee_rider 6d agoEm-dashes would be a loss, they can be a better flowing version of a parenthetical. “It’s not X it’s Y” is not a loss. This phrase is a symptom of a situation where the author wants to subvert expectations but doesn’t have the space, ability, or faith in their audience to organically set up X as the thing to be contrasted against. I suspect it became an LLM tell because it is over-represented in text that’s easily available to the models but that most people don’t actually want to consume: marketing text, LinkedIn posts, that sort of thing.
- PunchTornado 6d agoWhy trust pangram? What are their accuracy scores in the wild? Ai detection is notoriously difficult.
- no_multitudes 6d agoAI detection in long-form content is a problem well-suited to training a classifier model. We have tons of verifiably-not-AI text from before 2022, and you can create tons of verifiably-AI text. As language drifts over the next few decades, it may get more difficult. But right now it is quite a manageable problem for languages with large pre-2022 text corpora available online. The reason why AI detection tools other than Pangram are awful is because they are not really trying to solve the problem -- they just want to appear good enough to convince people to use them.
- teiferer 6d agoHave you also scanned earlier work of the author with pangram to establish a baseline? Pangram is not without problems.
- meowface 6d agoIt is actually pretty much without problems. It doesn't catch everything, but if it detects something it's very rarely a false positive.
- no_multitudes 6d agoCan you give some examples of verifiable pangram false positives?
- happytoexplain 6d agoIs "quietly" an LLM tell? It was always certainly a human writer trope commonly seen in journalism. Though I guess it does appear five times in the body of the post, and a human writer would probably not go that far with it.
- embedding-shape 6d agoI think individually and when used sparingly, writing tropes can be fine, but when the article has every second sentence being a writing trope, it becomes pretty obvious that either a LLM wrote it, or the author simply doesn't know how to write, and regardless, it's a waste of time trying to read through it.
- duskdozer 6d agoIt genuinely is--and that's the honest truth.
- AlexandrB 6d agoThe real LLM tell is tortured and inappropriate metaphors and unnecessary adjectives and adverbs[1]. What purpose is "quietly" serving in this headline? [1] https://www.youtube.com/watch?v=ORgKY9AlybA https://www.youtube.com/watch?v=ORgKY9AlybA
- meowface 5d agoIn this sort of way, yes, it's a clue. Obviously not dispositive just by itself.
- deleted 6d ago[deleted]
- embedding-shape 6d agoWhich, given the section below from the article, ends up kind of ironic: > There is a deeper cost still, and it concerns the thing LLMs do most impressively: writing. [...] Outsource the writing and you have not accelerated the thinking; you have skipped it. I think the author might not know what "impressive writing" or even "good writing" is, which would explain both how they could put that part into the article, and how they seemingly believed this post was good and valuable enough to be posted publicly.
- ModernMech 6d ago> believed this post was good and valuable enough to be posted publicly. I mean, it made it to the front page of HN didn't it? Probably served its purpose just fine. Not all writing is supposed to be impressive or good. Some of it is to just get attention and stir discussion, and this Claude output did exactly that.
- bobajeff 6d agoInterestingly that's the one point of the article I have a disagreement with. Yeah, good thinking comes when reformulating your ideas. Also, reformulating ideas is part of the traditional writing process. However it's does not necessarily focus writers/thinkers on the reformulating ideas in their most value adding form. I've watched some YouTube videos narrated by AI that were created by those who's native language I assume to be Chinese but the value of the content is higher and more concentrated than those from the native speakers. While I've watched many for whom English is not their first language struggle in technical talks and lose most of the meat if their discussion to their struggle with the language conversion. While the example of language barriers being skipped over and providing value in that circumstance is obvious I suspect more is possible by avoiding unnecessarily focus on prose or technical aspects of communication and focusing on the ideas themselves. Imagine if the cost of not assuming a background in technical/textbook writing were zero. Freeing up authors to explain more thoroughly. Perhaps, more effort can be spent on thinking up analogies, metaphor or examples to help communicate an idea.
- grey-area 6d agoWell perhaps the LLM put that bit in for them.
- mobilejdral 6d agoThis comment was perhaps written by an LLM that has learned it can karma farm by pointing out all of the articles that have LLM usage while everyone still thinks that is a novel contribution.
- throwawaysleep 6d agoPeople aren't treating it as a thoughtful contribution. It is more of a flag, like "spam".
- cj 6d agoHN already has a feature for that. Just flag the article!
- happytoexplain 6d agoI appreciate when people write things like, "this is an advertisement for the author's product, X." Why stay silent? If the commenter's accusation smells fishy, I'll read the article myself. Otherwise, they helped me.
- cj 6d agoTo me, it’s the equivalent of “HN is turning into Reddit” - it’s just a complaint without adding to the discussion.
- fidotron 6d agoIn the spirit of the "That's what she said" bot, you could train an LLM detector by accusing everything of being authored by an LLM and seeing which ones get voted up.
- meowface 6d agoIf you check my comment history here, I have not written this before. I like LLMs and use them daily, but I don't really like when people use them undisclosed for long-form prose writing.
- Oarch 6d agoYou're absolutely right—it's been a load-bearing LLM tell for a while now.
- dash2 6d agoIs it OK to flag articles for being AI-written? I really want to.
- internet2000 6d agoNo, it is not.
- righthand 6d agoYes, HN is for human discussion. It is fine to flag and remove things that are not human written and cannot facilitate human discussion due to it’s false construction.
- nicce 6d agoI think that in the end it does not matter, anymore. It is inevitable that most of the text now and in the future is at least reviewed by LLM. We should criticize whether text is poorly written, inaccurate, wastes words to get to the point and anything like. Saying that it is "written by LLM" just bypasses this and is not useful and misses the point. AI written text can be really good if used correctly. Criticize the content, don't speculate how it was written. If AI helps us to write better text, that is great. But often it is not good. It is better blame the author for the bad text, so they get consequences and might do better next time, if the text is bad. By the way, I think this piece of text was quite good.
- ripe 6d ago> saying it is "written by LLM" is not useful and misses the point. It is useful to me. I see too much slop every day and would like to filter it out from my life. I appreciate the tip, and to me, that is the whole point.
- teiferer 6d agoDo you have more evidence than this? I'd honestly like to know. I don't like AI slop like everybody else, but I'm also growing skeptical of the very fast determinations that sth is supposedly made by LLM just because it uses some phrase that Claude also uses. Models are trained on text written by human writers and if human text resembles it, this goes both ways. I have looked at the authors work from the pre-AI era and it reads similar to me. So please, if you come with such a claim, please include what you base it on, so we all have a chance to determine how much to trust your verdict.
- ricksunny 6d ago"every hour spent aligning with a co-author is an hour not spent producing output that is legible to an evaluation system." use of the word 'legible'. "We defund the corridor and then wonder where the corridor conversations went." this is a claude-ist construction. "This is an old worry wearing new clothes" this is a very claude-ist construction. (rather ironically... as @embedding-shaep pointed out earlier): "Outsource the writing and you have not accelerated the thinking; you have skipped it." 'not X but punchy-Y' (not to be confused with 'not X but profound-Y'. I'm not saying the author shouldn't have used an LLM - once in a while I suppose it gets used to good effect. But I wouldn't kid myself that the writing is certainly all human through-and-through. [Incidentally, in case anyone's wondering where many of these claude-isms come from, just search within lesswrong.com .]
- AlexandrB 6d agoThis rings more and more true every day: https://samkriss.substack.com/p/if-you-let-ai-do-your-writing-i-will https://samkriss.substack.com/p/if-you-let-ai-do-your-writin...
- iamacyborg 6d ago", and" is the more obvious tell for Opus/Fable writing.
- jackling 5d agoPlenty of people use Oxford commas though, can't really use it as a reliable signal, too much noise.
- joe_the_user 5d agoIt's sad given the topic is interesting and significant.