6 ms·
I wish Excel / Google Sheets supported Parquet export. I've worked with CSV files and Parquet files and found the latter a vast improvement. Chunking data is tr
by yingw787 6y ago
I wish Excel / Google Sheets supported Parquet export. I've worked with CSV files and Parquet files and found the latter a vast improvement. Chunking data is trivial, you have fixed-size data types, and existing types are well-supported across a multitude of frameworks.
In comparison, CSVs are pretty much unstructured text files with added suggestions.
More pipelines should natively support Parquet files, or something like it, and have a thin CSV to Parquet conversion layer on top.
P.S. I'd love to create a Parquet file visualization tool (something like https://github.com/in3rsha/sha256-animation https://github.com/in3rsha/sha256-animation) in the near future.