8 ms·
Once your CSV (or TSV) files start having quoted fields, they become very tricky to parse using standard multi-purpose tools like sort, awk, & uniq. It's hard
by zbanks 13y ago
Once your CSV (or TSV) files start having quoted fields, they become very tricky to parse using standard multi-purpose tools like sort, awk, & uniq.
It's hard enough when you have delimiters in quoted fields, but dealing with quoted newlines starts to become unreasonable, especially for line-based tools.
CSV files, as you say, are absolutely wonderful to create. Problems come up when you try to parse files other people write. Not everyone follows RFC 4180.
- guard-of-terra 13y agoWith tab separated values this is not a big problem in practice. On the other hand, you can sort tsv, but you can't sort quoted csv.
- sopooneo 13y agoWhy not? I ask in earnest.
- guard-of-terra 13y agosort -n gets confused by quotes.
- jwilliams 13y agoProblems come up when you try to parse files other people write. Not everyone follows RFC 4180. Plus you've got encodings. If you're accepting CSVs from users, they'll generally come from Excel, which will produce different encoding in different circumstances.