Software Engineer - Query Engines

About Polars

Polars is the next generation of DataFrames. We don’t take the easy route and build from the ground up, controlling every element allows us to create a superior solution. Our open-source implementation is one of the fastest growing data projects on GitHub and has over 30 thousand stars and 100 million downloads to date.

We believe data processing should be a seamless experience from working locally on your development machine to an enterprise production environment. There should be one framework to learn for data practitioners, removing the need for rewriting code when going to production. To make that possible, we are building a cloud platform to seamlessly bring locally developed Polars pipelines to production. We are also building a distributed engine for Polars to scale beyond the limits of a single machine, both in the cloud and on-premises.

How will you make an impact?

As a member of the compute team your task is to define the characteristics of our query engines (streaming, distributed, in-memory). Together with your team members you’ll define high impact areas and improve the performance, consistency and maintainability of our engines. You switch between designing and implementing our systems with a hands-on approach. You like to ship code to millions of users and like bringing in cutting edge ideas into practice.

Requirements:

• Familiarity with query execution models (e.g., vectorized execution & pipelining).