6 ms·
I also did a couple of experiments with pruning LLMs[1] using genetic algorithms and you can just keep removing a surprising amount of layers in big models befo
by snats 1y ago
I also did a couple of experiments with pruning LLMs[1] using genetic algorithms and you can just keep removing a surprising amount of layers in big models before they start to have a stroke.
[1]https://snats.xyz/pages/articles/pruningg.html https://snats.xyz/pages/articles/pruningg.html
- kridsdale1 1y agoI suspect this applies to human beings as well.
- littlestymaar 1y agoWell, humans don't have “layers” in the first place…
- Legend2440 1y agoOf course not, that’s ogres.
- TeMPOraL 1y agoThere's https://en.wikipedia.org/wiki/Hydrocephalus# https://en.wikipedia.org/wiki/Hydrocephalus# and there are cases of people living normal lives, not realizing they're missing most of their brains, until this gets discovered on some unrelated medical test. Or people who survived an unplanned brain surgery by rebar or bullet. Etc.