I'd argue that we'd need some evidence of actual intelligence, reasoning, imagination, original thinking etc. The scary bit, imho, is that even without those,

I'd argue that we'd need some evidence of actual intelligence, reasoning, imagination, original thinking etc. The scary bit, imho, is that even without those, a "dumb" LLM can still do a lot of damage by just blindly following prompts without a notion for how it affects the "real world".