We looked at Parquet early on and it wasn’t competitive even with what we were using at the time. And yeah, this really depends not just on the dataset, but also on how selective your queries are, what predicates and…
One thing people commonly miss about this is this is all meaningless if you don’t have the corresponding runtime integration, and these techniques very much imply co-design, and therefore tight coupling, between the…
This already exists, in Google BigQuery. Uses darn near every trick in the book, and some that aren’t in the book. Source: shipped it.
We looked at Parquet early on and it wasn’t competitive even with what we were using at the time. And yeah, this really depends not just on the dataset, but also on how selective your queries are, what predicates and…
One thing people commonly miss about this is this is all meaningless if you don’t have the corresponding runtime integration, and these techniques very much imply co-design, and therefore tight coupling, between the…
This already exists, in Google BigQuery. Uses darn near every trick in the book, and some that aren’t in the book. Source: shipped it.