dm03514
- Karma
- 0
- Created
- ()
- Submissions
- 0
- Show HN: Control – Data Observability for Postgres, Pipelines and CDC (control.turbolytics.io)
Hello Everyone! I built control.turbolytics.io for data observability. The goal is to provide a cost-effective way to monitor postgres and data pipelines at scale. Onboarding a new db takes minutes. Controls entire…
- Show HN: Monitor Postgres Health (github.com)
Hello, my name is Danny and I created dbhealth to monitor postgres. I have an SRE background and was working in data eng for a couple years. dbhealth provides verdicts on health and exposes these through: - statsd -…
- Data needs its DevOps moment (render.com)
- Show HN: Real-Time Bluesky Post Firehose in < 256MB (turbolytics.io)
Hello everyone, I'm still trying to get some traction with sqlflow! I'm completely disenchanted with the modern data stack, and am trying to create a toolchain that helps treat data as if it were software:…
-
Hello Everyone! I just released sqlflow v1, which includes a go core rewrite. https://github.com/turbolytics/sql-flow This allows for ~10x higher throughput, over the python core, and more predictable memory usage! This…
-
Every day I'm seeing blogs on here about the impact of AI on software engineering. Sentiment seems split between AI eventually automating the software engineer role away, vs AI produces too many bugs to displace senior…
- Show HN: Tools for Humans – Public Tracker for Workflows (turboops.io)
Hello! I'm working on building out graph-based tools for humans! Our first offering is a public tracker view, similar to the tracker provided by pizza companies in the US! The goal is to enable companies to reduce…
- Show HN: DuckDB for Kafka Stream Processing (sql-flow.com)
Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using…
-
Introducing Librarian: A Modern Alternative to Kafka Connect We're excited to share Librarian, an open-source database replicator built for the cloud-native era. The Problem We're Solving: Traditional CDC solutions like…
-
Ducklake is a new lake storage format by MotherDuck. It aims to solve some of the issues with Iceberg by centralizing metadata in Postgres, instead of directly on blob storage. SQLFlow is a stream processing engine that…
-
Hello! I've been working on building a flink alternative using DuckDB. Building off of DuckDB makes it easy to leverage all the integrations DuckDB supports. Using batching it's trivial to insert 5000 rows / second into…
- Show HN: Execute SQL against Bluesky firehose (github.com)
- Show HN: Librarian a Modern Kafka Connect Toolkit (github.com)
Hello Everyone. I'm working on improving Kafka Connect. Kafka connect lacks a lot of data visibility, making it difficult to use and operate as a backbone of data pipelines. We're trying to create a kafka connect for…
-
Hello everyone, this is a bit of a compound question, but I think related in some ways: Does anyone have good resources to learn about strategic military operations? For example, why does Ukraine choose the targets it…
-
Hello! As a software engineer I've become very frustrated with the state of the modern data stack and the state of data teams. https://www.linkedin.com/pulse/draining-data-lake-part-1-3-p... Many outputs of data teams…
- Show HN: SQLFlow: SQL Stream Processing Using DuckDB (github.com)
I'm a couple years late to the party but DuckDB is blowing my mind. I couldn't find an good embedded DuckDB stream processing solution so I hacked my own, calling it SQLFlow: https://github.com/turbolytics/sql-flow…
- Some Ways to Calculate MAU (on-systems.tech)
- Draining the Data Lake (part 1 of 3) – Problems (on-systems.tech)
-
Hello! My name is Danny and I am working on spinning up turbolytics.io to help software engineering managers better understand their team performance! Our first product is the Engineering Health Report which provides a…