7 ms·Yes, but parquet hates small files.by aynyc 7mo agoYes, but parquet hates small files.dionian 7mo agoYou can't compact? i.e. iceberg maintenanceaynyc 7mo agoWe might be doing something wrong, but we saw significant performance degradation for both ingestion and query when doing compaction when it comes to finance data during trading hours.