8 comments

[ 1244 ms ] story [ 2749 ms ] thread
How does it compare to Arrow?
Any comparisons with Lance/LanceDB?
How well does this work with partial downloading of a file based on column statistics via HTTP Range requests?

Any plans to integrate FastLanes into DuckDB? You would instantly get more usage from its SDKs in many languages and the CLI.

My experience with parquet is that the (C++) libraries are pretty awful and resulting performance lackluster
Pretty cool!

WebAssembly planned?

How well does the expression detection scale with number of columns? If I am reading Table 4 correctly FastLanes is ~10x slower at encoding than parquet+snappy (which seems a reasonable tradeoff for the better compression and scan times) but how is that affected for very wide tables (eg 2k columns or something like that)
Is there a place where we can contribute?