> While we do need to write sandbox metadata and results to durable storage, we do so largely asynchronously. How do you guarantee durability of sandbox task metadata if it’s written to durable storage async? What if…
Makes sense thanks!
What was the hardest part/most unexpected design challenge in getting this to work?
Do you binpack containers such that you overcommit cpu/ram on the machines to drive up utilization? Did you do any simulations to see if this optimistic distributed scheduling approach maintains on-par utilization and…
Every scheduler node has cached view of whole cluster and optimistically makes a scheduling decision, retrying on conflict? Any tricks you did to reduce conflict rate? Is there a certain cluster saturation threshold…
> While we do need to write sandbox metadata and results to durable storage, we do so largely asynchronously. How do you guarantee durability of sandbox task metadata if it’s written to durable storage async? What if…
Makes sense thanks!
What was the hardest part/most unexpected design challenge in getting this to work?
Do you binpack containers such that you overcommit cpu/ram on the machines to drive up utilization? Did you do any simulations to see if this optimistic distributed scheduling approach maintains on-par utilization and…
Every scheduler node has cached view of whole cluster and optimistically makes a scheduling decision, retrying on conflict? Any tricks you did to reduce conflict rate? Is there a certain cluster saturation threshold…