Lightweight solution to PyTorch for distributed training, across different modules: NATS.io provides a fault-tolarent communication bit across networks with publsh and fetch on given ids.