5 ms·
I prefer to use clickhouse-local for all my CSV needs as I don't need to learn a new language (or cli flags) and can just leverage SQL. clickhouse local --
by pradeepchhetri 1y ago
I prefer to use clickhouse-local for all my CSV needs as I don't need to learn a new language (or cli flags) and can just leverage SQL.
clickhouse local --file medias.csv --query "SELECT edito, count() AS count from table group by all order by count FORMAT PrettyCompact"
┌─edito──────┬─count─┐
│ agence │ 1 │
│ agrégateur │ 10 │
│ plateforme │ 14 │
│ individu │ 30 │
│ media │ 423 │
└────────────┴───────┘
With clickhouse-local, I can do lot more as I can leverage full power of clickhouse.
- sitkack 1y agoI use SQLite in a similar manner, but I'll have to check this out.
- rixed 1y agoHow does it compare with duckdb, which I usualy resort to? What I like with duckdb is that it's a single binary, no server needed, and it's been happy so far with all the CSV file I've thrown at it.
- pradeepchhetri 1y agoclickhouse-local is similar to duckdb, you don't need a clickhouse-server running in order to use clickhouse-local. You just need to download the clickhouse binary and start using it. clickhouse local ClickHouse local version 25.4.1.1143 (official build). :) There are few benefits of using clickhouse-local since ClickHouse can just do lot more than DuckDB. One such example is handling compressed files. ClickHouse can handle compressed files with formats ranging from zstd, lz4, snappy, gz, xz, bz2, zip, tar, 7zip. clickhouse local --query "SELECT count() FROM file('top-1m-2018-01-10.csv.zip :: *.csv')" 1000000 Also clickhouse-local is much more efficient in handling big csv files[0] [0]: https://www.vantage.sh/blog/clickhouse-local-vs-duckdb https://www.vantage.sh/blog/clickhouse-local-vs-duckdb
- rixed 1y agoWanted to try it. Debian package is of poor quality: not even sure if clickhouse local is included in there, I believe so but there is no manpage, no doc at all, and no `clickhouse-server -h`. Went to the official page looking for a tarball to download, found only the `curl|sh` joke. Went to github looking for tagged tarballs, couldn't find any. Looked for INSTALL.md, couldn't find any. Will try harder later, have to weep my tears for now.
- pradeepchhetri 1y ago> Debian package is of poor quality Can you elaborate more please? I would love if you can say what all can be improved to make debian package up to standards.
- rixed 1y agoThank you for your interest. My comment was really about the state of documentation ("there is no manpage, no doc at all, and no `clickhouse-server -h`"). More specifically: % dpkg -S clickhouse-server | grep bin clickhouse-server: /usr/sbin/clickhouse-server % man clickhouse-server No manual entry for clickhouse-server % man clickhouse No manual entry for clickhouse % /usr/sbin/clickhouse-server --help Unknown option specified: help % /usr/sbin/clickhouse-server -h Unknown option specified: h % ls -l /usr/share/doc/clickhouse-server total 60 -rw-r--r-- 1 root root 235 Dec 5 2022 changelog.Debian.amd64.gz -rw-r--r-- 1 root root 1437 Dec 5 2022 changelog.Debian.gz -rw-r--r-- 1 root root 33174 Dec 20 2018 changelog.gz -rw-r--r-- 1 root root 15057 Oct 29 2022 copyright
- zX41ZdbW 1y agoClickHouse is a single binary. It can be invoked as clickhouse-server, clickhouse-client, and clickhouse-local. The help is available as `clickhouse-local --help`. clickhouse-local also has a shorthand alias, `ch`. This binary is packaged inside .deb, .rpm, and .tgz, and it is also available for direct download. The curl|sh script selects the platform (x86_64, aarch64 x Linux, Mac, FreeBSD) and downloads the appropriate binary.
- SoftTalker 1y agoI used to use q for this sort of thing. Not sure if there are better choices now as it have been a few years. https://harelba.github.io/q/ https://harelba.github.io/q/