We just open-sourced our Meltano (Singer) target[0] for Ducklake (from DuckDB). This gives you access to 500+ connectors (e.g. Hubspot, Stripe, Postgres, etc.):
* Type conversion is automatic (timestamps stay timestamps).
* Append or merge: choose at runtime.
* Storage is portable (S3, GCS, or local).
* Works with Postgres, MySQL, SQLite, or DuckDB catalogs.
* Timestamp and categorical partitions are built in.
We're already running it in production here at Definite and open to feature requests / PRs.
1 comment
[ 3.3 ms ] story [ 16.9 ms ] thread* Type conversion is automatic (timestamps stay timestamps).
* Append or merge: choose at runtime.
* Storage is portable (S3, GCS, or local).
* Works with Postgres, MySQL, SQLite, or DuckDB catalogs.
* Timestamp and categorical partitions are built in.
We're already running it in production here at Definite and open to feature requests / PRs.
0 - https://github.com/definite-app/target-ducklake