5 ms·
If only the blog itself wasn't written by AI? >No reasoning. No capability. Just exploitation of how the score is computed. shudder
by danslo 5mo ago
If only the blog itself wasn't written by AI?
>No reasoning. No capability. Just exploitation of how the score is computed.
shudder
- gaythread 5mo ago[flagged]
- cpldcpu 5mo agoYes, marks of AI all over the place. Also the SVGs. >No solution written, 100% score. Its weird. Turns out that hardest problem for LLMs to really tackle is long-form text.
- sidpatil 5mo agoSomeone here mentioned a whole ago that the labs deliberately haven't tried to train these characteristics out of their models, because leaving them in makes it easier to identify, and therefore exclude, LLM-generated text from their training corpus.
- blymphony 5mo agoBut it's odd that these characteristics are the same across models from different labs. I find it hard to believe that researchers across competing companies are coordinating on something like that.
- basch 5mo agoMaybe in one shot. In theory I would expect them to be able to ingest the corpus of the new yorker and turn it into a template with sub-templates, and then be able to rehydrate those templates. The harder part seems to be synthesizing new connection from two adjacent ideas. They like to take x and y and create x+y instead of x+y+z.
- Quarrel 5mo agoMost of the good major models are already very capable of changing their writing style. Just give them the right writing prompt. "You are a writer for the Economist, you need to write in the house style, following the house style rules, writing for print, with no emoji .." etc etc. The large models have already ingested plenty of New Yorker, NYT, The Times, FT, The Economist etc articles, you just need to get them away from their system prompt quirks.
- ainch 5mo agoI think that should be true, but doesn't hold up in practice. I work with a good editor from a respected political outlet. I've tried hard to get current models to match his style: filling the context with previous stories, classic style guides and endless references to Strunk & White. The LLM always ends up writing something filtered through tropes, so I inevitably have to edit quite heavily, before my editor takes another pass. It feels like LLMs have a layperson's view of writing and editing. They believe it's about tweaking sentence structure or switching in a synonym, rather than thinking hard about what you want to say, and what is worth saying. I also don't think LLMs' writing capabilities have improved much over the last year or so, whereas coding has come on leaps and bounds. Given that good writing is a matter of taste which is beyond the direct expertise of most AI researchers (unlike coding), I doubt they'll improve much in the near future.
- basch 5mo agoYou're ignoring what I said. They work better when turning it into a two step process. Step 1 create a template. Step 2 execute the template. >The large models have already ingested plenty of New Yorker, NYT, The Times, FT, The Economist etc articles And that ends up diluting them. Going back and doing another pass on only a subset would give them stronger voice. At some threshold, scanning information brings it to average and a return to the mean, instead of increasing the information. It's a giant table of word associations, it can regress.
- benob 5mo agoNo, the failure is the human written prompt
- not_that_d 5mo agoYou know, after a while this excuse is not valid anymore.
- roywiggins 5mo agoIf they're that hard to prompt maybe it's easier just to write the blog posts yourself.
- alexchantavy 5mo agoI wonder what college freshman-level writing classes are teaching about writing voice and AI. The tell-tale patterns are pretty frustrating to read.
- stefan_ 5mo agoWhatever classes these guys took, they skipped the one on scientific misconduct.
- wxw 5mo agoAgreed. The premise is interesting but reading content like this is grating.
- trueno 5mo agoim actually getting so tilted that people can't just be forthcoming about when they used AI to write something. 99% of readme.mds i run into now on github piss me off. out of all the things people could cede to automation, they foolishly went and self-owned their ability to communicate. smfh. if you've worked on something diligently and understand it and have novel insight to share, let's hear _your_ damn voice.
- roywiggins 5mo agoyeah I don't hate LLM docs if they're labeled as such. but if someone wants me to use their code or read their README.md they are going to have to make it sound like a human cared about writing it, and right now Claude can't do that
- 1270018080 5mo agoWriting is still an art, and AI will never be able to do it well like all other forms of art.
- 0xbadcafebee 5mo agoWhat exactly is making you shudder - the writing style, or the fact that AI was used at all? Because if it's the latter, just so you know, you're going to be shuddering for the rest of your life.
- amenhotep 5mo agoYeah. We know. That's why it's so fucking awful.