6 ms·
“sync,corrected by elderman” issue in ML translation datasets spread on internet
- h2odragon 4y agoi think that might've come from the rtfm.mit.edu FAQ archives, there were several documents there that had multiple language versions and were great bait for things needing translated text inputs.
- mvolfik 4y agoI can't find the true origin of this, but (unless I'm missing some old internet joke) it seems like some language models have some corrupt training data frequently including a string like "== sync, corrected by elderman ==". Now searching for this phrase yields a ton of random results occurring in places where you would expect automatically translated spam. Some interesting mentions I found: - it historically appeared in autotranslated game chats in Arena of Valor game https://www.reddit.com/r/arenaofvalor/comments/btykru/comment/ep4o48c/ https://www.reddit.com/r/arenaofvalor/comments/btykru/commen... - mention on GitHub repo of a translation model https://github.com/Helsinki-NLP/Opus-MT/issues/62 https://github.com/Helsinki-NLP/Opus-MT/issues/62 I'm curious to see if anyone else has interesting encounters with this
- deleted 4y ago[deleted]