Hashpipe - The High Availability SHared PIPeline Engine The best place to learn about Hashpipe is from these nice tutorial/demos: https://github.com/SparkePei/demo1_hashpipe https://github.com/SparkePei/demo2_hashpipe