apply() - Tying the Room Together: Apache Arrow and the Next Generation of Data Analytics Systems

Wes McKinney, Creator of pandas and CEO and Founder, Ursa

In this talk, I will discuss the coming architectural shift in data analytics systems that has been enabled by the widespread adoption of Apache Arrow, a universal language-independent standard for analytical data processing, and companion technologies for data storage like Apache Parquet. This will include topics such as user language integration, hardware acceleration and processing efficiency, data interoperability and transport, and more. I will discuss implications for data engineers and data scientists today as well as how to plan for a future built increasingly on interoperable open standards.