Machine Learning Systems are Stuck in a Rut

Authors: Paul Barham, Michael Isard - Proceedings of the Workshop on Hot Topics in Operating Systems 2019 cited by 65

In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability. Systems researchers are doing an excellent job improving the performance of 5-year-old benchmarks, but gradually making it harder to explore innovative machine learning research ideas.