Show HN: Setup a gpu optimized spark/hadoop cluster with docker compose

7 points by agibsonccc ↗ HN
Hey folks, I figured this might be useful for a few people who want to play with hadoop and spark locally. Feedback hugely appreciated.

  I built this from the pain of wanting to setup a cluster for demos. 
I have gpu bits in there due to the use case but figured maybe some could draw inspiration from this.

Happy to answer questions if there's any interest.

Link here: https://github.com/deeplearning4j/docker

0 comments

[ 2.9 ms ] story [ 11.3 ms ] thread

No comments yet.