Thinking about how you would shard your data is hardly over engineering. On some storage systems you are forced to anyway: Cassandra, dynamodb. And the cost of

Thinking about how you would shard your data is hardly over engineering. On some storage systems you are forced to anyway: Cassandra, dynamodb. And the cost of building the solution from the onset is hardly a killer. The pain usually comes from operational complexity.