Ingesting 1Gbps of logs into ClickHouse for $180/month (opendata.dev) 18 points by apurvamehta 1mo ago ↗ HN
[–] mannyv 1mo ago ↗ You don't really need clickhouse in this pipeline. And it's interesting (but obvious once said) that you can replace kafka with s3...at least in the "scalable and reliable destination for lots of data" dimension. [–] apurvamehta 1mo ago ↗ It's a demonstration. Kafka is a very popular input for Clickhouse. So are data lakes. The point is neither need Kafka at all. [–] mannyv 1mo ago ↗ That's how far s3 has come - it's replacing products that were the pinnacle of scalability back in the day.I have to look a bit, but it could probably replace Cassandra now as well.
[–] apurvamehta 1mo ago ↗ It's a demonstration. Kafka is a very popular input for Clickhouse. So are data lakes. The point is neither need Kafka at all. [–] mannyv 1mo ago ↗ That's how far s3 has come - it's replacing products that were the pinnacle of scalability back in the day.I have to look a bit, but it could probably replace Cassandra now as well.
[–] mannyv 1mo ago ↗ That's how far s3 has come - it's replacing products that were the pinnacle of scalability back in the day.I have to look a bit, but it could probably replace Cassandra now as well.
3 comments
[ 2.9 ms ] story [ 15.1 ms ] threadI have to look a bit, but it could probably replace Cassandra now as well.