1egg0myegg0
No user record in our sample, but 1egg0myegg0 has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
No user record in our sample, but 1egg0myegg0 has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
Whoever gets that magical -2,147,483,648 is going to be really surprised that things keep working
It is already available in the local DuckDB UI! Let us know what you think! -Customer software engineer at MotherDuck
Extension downloads are validated using a signature check to prevent tampering! (I work for DuckDB Labs and MotherDuck)
There are many! https://www.thespruce.com/duck-species-list-385436
Howdy! The docs reflect the latest dev branch. For a specific release, you can pick it from the version dropdown in the top right!
You could definitely run a pivot with the SQLite attach! All of the DuckDB syntax works!
You can think of the attach operation as creating views in DuckDB with Postgres tables underneath! DuckDB will then query those Postgres rows (using the typical Postgres wire protocol, except in binary mode). No data is…
We have one of those! :-) And yes it is fast! https://github.com/duckdblabs/sqlite_scanner
DuckDB can actually read SQLite or Postgres directly! In the SQLite case, something like Litestream plus DuckDB could work really well! Also, with Pyarrow's help, DuckDB can already do this with Delta tables!…
Good question! As a disclaimer, I work for DuckDB Labs. There are 2 big benefits to working with Parquet files in DuckDB, and both relate to speed! DuckDB can query parquet right where it sits, so there is no need to…
I should add that we can read/write Apache Arrow as well!
Ah, well, that was a risk that I took... Thank you for the feedback though! The Star Wars puns were too hard to resist... If you have a specific question, definitely post it here and I will clarify!
Fugue has a DuckDB back end and I believe they can actually use Dask and DuckDB in combination for what I believe is similar to what you are looking for! There is also a way to map Python functions in DuckDB using the…
Good questions! You are correct that it depends. We do have indexes to help with point queries, but they are not going to be quite as fast as SQLite because DuckDB stores data in a columnar format. (Soon they will be…
Thank you for the feedback! I will check those Clickhouse features out. I totally agree on the trailing commas, and I use commas first syntax for that same reason! But maybe not anymore... :-)
Close! DuckDB has very fast bulk insert speeds, but slower individual row insertion/update speeds. (Disclaimer: I write docs for DuckDB)
We have a Relational API in addition to SQL! Here are some examples for the Python Relational API client: https://github.com/duckdb/duckdb/blob/master/examples/python... Plus, if you are working in Python, you can use…
Since DuckDB is so portable, it can be a good choice for adding a SQL parser to a new system. Have a look here for an example that uses the parser separately from the execution engine:…
If you wouldn't mind, please update DuckDB as well!
I should also add that there is a duckdb fdw, so you could have DuckDB read from your parquet files and do faster transformations before you pull your data into Postgres! https://github.com/alitrack/duckdb_fdw
DuckDB has a few options for custom functions! I'm not sure exactly how optimized they are relative to what you have in mind, but I believe there is still quite a lot of query optimization that you get out of the box.…
Yes! DuckDB (not WASM DuckDB) has a JDBC connector that works with DBeaver.
Check out this post for some comparisons with Pandas. https://duckdb.org/2021/05/14/sql-on-pandas.html DuckDB is often faster than Pandas, and it can handle larger than memory data. Plus, if you already know SQL, you…