apply() - Third Generation Production ML Architectures: Lessons from History, Experiences with Ray

Wednesday, April 21, 11:40am - 12:10pm (PDT)

Speaker: Waleed Kadous, Anyscale

Production ML architectures (deployed at scale in production) are evolving at a rapid pace. We suggest there have been two generations so far: the first generation were very much fixed function pipelines with predetermined stages, the second generation was pluggable components with a bit more flexibility but still pretty constrained. If history is a guide (especially looking at the evolution of GPU APIs), the third generation is going to come from making the computational power accessible and flexible.

We share our experiences with Ray, a system that makes distributed computing accessible and flexible. We give a two slide introduction to Ray, and show how Ray’s flexibility enables approaches like online reinforcement learning that are not easy to fit in to existing production ML architectures without some serious shoe-horning.

We then outline how different companies (such as Uber, Ant Financial, McKinsey) are using Ray in a way that extends beyond the constraints of existing second generation architectures.

Add to Calendar 2021/04/21 11:40:00 2021/04/21 12:10:00 America/Los_Angeles apply() - Third Generation Production ML Architectures: Lessons from History, Experiences with Ray Speaker: Waleed Kadous, Anyscale

Production ML architectures (deployed at scale in production) are evolving at a rapid pace. We suggest there have been two generations so far: the first generation were very much fixed function pipelines with predetermined stages, the second generation was pluggable components with a bit more flexibility but still pretty constrained. If history is a guide (especially looking at the evolution of GPU APIs), the third generation is going to come from making the computational power accessible and flexible.

We share our experiences with Ray, a system that makes distributed computing accessible and flexible. We give a two slide introduction to Ray, and show how Ray’s flexibility enables approaches like online reinforcement learning that are not easy to fit in to existing production ML architectures without some serious shoe-horning.

We then outline how different companies (such as Uber, Ant Financial, McKinsey) are using Ray in a way that extends beyond the constraints of existing second generation architectures.
https://us02web.zoom.us/j/81406729277 or YouTube Live link on Slack false MM/DD/YYYY 30 OPAQUE awFyHhintzGWPNfvXmVh109699

Wednesday, April 21, 11:40am - 12:10pm (PDT)

https://us02web.zoom.us/j/81406729277 or YouTube Live link on Slack