6 ms·
18k lines is very small, CSVs are fine as storage option. My rule of thumb is that anything that fits into Excel (approx 1M lines) is "small data" and can be a
by brunokim 2y ago
18k lines is very small, CSVs are fine as storage option.
My rule of thumb is that anything that fits into Excel (approx 1M lines) is "small data" and can be analysed with Pandas in memory.
- eth0up 2y agoHey, thanks for taking the time to reply. I won't be reaching 1M anytime soon, so good to know!