mwc360
No user record in our sample, but mwc360 has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
No user record in our sample, but mwc360 has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
Very cool! This seems like fantastic functionality and would make it super easy to migrate small Spark workloads to DuckDB :)
Author here: that’s exactly what I was trying to communicate but you said it better :)
Author of the blog here: fair point. Pretty much every published benchmark has an agenda that ultimately skews the conclusion. I did my best here to be impartial, I.e I fully designed the benchmark and each test prior…
Miles Cole here… thx for the correction, another reader just notes this as well. I’ll get this corrected tomorrow and possibly retest after verifying I have spill set up. Thx!
Hi - Miles Cole here… I used lazy APIs where available. I.e. everything up to write_delta() is lazy in the Polars (Mod) variant. Yeah I was debating whether to share all of the source code. I may share a portion of it…