Rust Engineer

About the Role

You’ll own LiteLLM’s migration from Python to Rust, end to end.

This is a high-stakes, high-visibility role where you will:

• Plan the migration directly with the CTO
• Restructure the existing codebase so it is ready for an incremental move to Rust
• Lead a gradual, stability-first rollout
• Drive LiteLLM toward becoming the lowest-latency, highest-throughput AI gateway in the category
• Ensure performance improvements never compromise the reliability our enterprise customers depend on

This is a single-owner mandate. You will be the person responsible for leading the entire Python-to-Rust migration.

Responsibilities

• Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through production rollout
• Plan the migration alongside the CTO and sequence the work to minimize risk to live, high-volume traffic
• Design and execute a gradual rollout with stability as the top constraint
• Restructure the existing codebase to enable a clean, incremental migration
• Drive improvements across latency, throughput, and resource efficiency at more than 1 billion requests per month
• Collaborate across teams to align the migration with backend priorities across performance, reliability, and security