5 ms·
But can o3 write a symphony? Seriously though, I'd like to hear suggestions on how to automatically evaluate an AI model's creativity, no humans in the loop.
by optimalsolver 2y ago
But can o3 write a symphony?
Seriously though, I'd like to hear suggestions on how to automatically evaluate an AI model's creativity, no humans in the loop.
- fragmede 2y agowe'd have to create a numerical scale for creativity, from boring to Dali, with milliEschers and MegaGeigers somewhere in there as well
- rpastuszak 2y agoIt's essential that we quantify everything so that we can put a price on it. I'd go with Kahlograms though.
- johnfn 2y agoHave you tried suno.ai?
- baq 2y agoLLMs have read everything humans made so just ask one if there’s anything truly new in that freshly confabulated slop-phony.
- gsam 2y agoIn my view there's two modes of creativity: 1. That two distant topics or ideas are actually much more closely related. The creative sees one example of an idea and applies it to a discipline that nobody expects. In theory, reduction of the maximally distant can probably be measured with a tangible metric. 2. Discovery of ideas that are even more maximally distant. Pushing the edge, and this can be done by pure search and randomness actually. But it's no good if it's garbage. The trick is, what is garbage? That is very context dependent. (Also, a creative might be measured on the efficiency of these metrics rather than absolute output)
- docfort 2y agoTerry Tao has referred to this classification system as foxes vs hedgehogs. https://en.m.wikipedia.org/wiki/The_Hedgehog_and_the_Fox https://en.m.wikipedia.org/wiki/The_Hedgehog_and_the_Fox
- deleted 2y ago[deleted]