1200 core k8s cluster + 1.5PB ceph (shared nodes to some degree) no issues with persistent disks etc, only "annoying" thing is to figure out RBAC initially you

1200 core k8s cluster + 1.5PB ceph (shared nodes to some degree) no issues with persistent disks etc, only "annoying" thing is to figure out RBAC initially you just use a storagecontroller, then its no work whatsoever, ceph does the rest