Skip to yearly menu bar Skip to main content


Poster

Gradient Coding: Avoiding Stragglers in Distributed Learning

Rashish Tandon · Qi Lei · Alexandros Dimakis · Nikos Karampatziakis

Gallery #136

Abstract:

We propose a novel coding theoretic framework for mitigating stragglers in distributed learning. We show how carefully replicating data blocks and coding across gradients can provide tolerance to failures and stragglers for synchronous Gradient Descent. We implement our schemes in python (using MPI) to run on Amazon EC2, and show how we compare against baseline approaches in running time and generalization error.

Live content is unavailable. Log in and register to view live content