Spark is still a safe port when compared to DuckDB and Polars (mertkavi.com) 2 points by mertkavi 3y ago ↗ HN
[–] zX41ZdbW 3y ago ↗ You should compare to ClickHouse: https://github.com/ClickHouse/ClickHouse/See this tutorial for local data processing: https://clickhouse.com/blog/extracting-converting-querying-l...I'm a developer of ClickHouse, and I can proudly say that the system's performance, feature completeness, usability, and maturity are second to none. [–] crop_rotation 3y ago ↗ Just for my curiosity, Is the clickhouse internal columnar file format documented somewhere? [–] zX41ZdbW 3y ago ↗ Not much - the source code contains a brief description. See MergeTreeData.h, MergeTreeDataPartWide, MergeTreeDataPartCompact.
[–] crop_rotation 3y ago ↗ Just for my curiosity, Is the clickhouse internal columnar file format documented somewhere? [–] zX41ZdbW 3y ago ↗ Not much - the source code contains a brief description. See MergeTreeData.h, MergeTreeDataPartWide, MergeTreeDataPartCompact.
[–] zX41ZdbW 3y ago ↗ Not much - the source code contains a brief description. See MergeTreeData.h, MergeTreeDataPartWide, MergeTreeDataPartCompact.
3 comments
[ 3.6 ms ] story [ 20.5 ms ] threadSee this tutorial for local data processing: https://clickhouse.com/blog/extracting-converting-querying-l...
I'm a developer of ClickHouse, and I can proudly say that the system's performance, feature completeness, usability, and maturity are second to none.