This approach reminds me of ClickHouse's MergeTree. Also, https://paimon.apache.org/ seems to be better for streaming use cases.
In order to get good query performance from Iceberg, we have to run compaction frequently. Compaction turns out to be very expensive. Any tip to minimize compaction while keeping queries fast?
This approach reminds me of ClickHouse's MergeTree. Also, https://paimon.apache.org/ seems to be better for streaming use cases.
In order to get good query performance from Iceberg, we have to run compaction frequently. Compaction turns out to be very expensive. Any tip to minimize compaction while keeping queries fast?