For more distributed training features and practices, please follow:
Quick start for distributed training : quick start for distributed training。