I've been recently thinking of this as similar to Data Warehouses vs a normal Relational Database. The Data Warehouse has a variety of usecases around analytics

I've been recently thinking of this as similar to Data Warehouses vs a normal Relational Database. The Data Warehouse has a variety of usecases around analytics or marketing where it has replaced RDBs, but for other usecases – especially around your core application transactions – you still need your Database. Similarly, if you're doing something like generating medical/therapy notes, or generating SAT questions then GPT is great, but for transactions or cases where exact behavior is a requirement, then you sort of need a discrete set of instructions that only a programming language can provide. You're not going to see payments systems built by GPT in the short term at least.