Check out Determined (https://github.com/determined-ai/determined). It supports deploying onto k8s and handles running horovod (and soon other dtrain backends), with most of the complexity abstracted behind a few…
And general relatively is just the straggler effect because the computation takes longer where mass is concentrated. Empirical evidence the universe is just a large hadoop install.
Check out Determined (https://github.com/determined-ai/determined). It supports deploying onto k8s and handles running horovod (and soon other dtrain backends), with most of the complexity abstracted behind a few…
And general relatively is just the straggler effect because the computation takes longer where mass is concentrated. Empirical evidence the universe is just a large hadoop install.