Building a Cost-Efficient and Reliable Spark Platform on K8s (60–90% Savings) (notion.com)

I wrote this and I’m happy to answer any questions about savings, infrastructure, how we built and tested this in our environment, or open sourcing it with AWS.

Repo is here: https://github.com/aws-samples/sample-spot-balancer-spark-ek...