Rust System Engineer - GPU Infrastructure

Your mission

To support our growing engineering team, we are looking for an experienced Rust Engineer to help build low-level infrastructure for next-generation AI workloads.

In this role, you will work close to the system boundary, developing node-level daemons, dynamic library interceptors, async Rust services, Kubernetes integrations, lightweight HTTP/gRPC services, and performance-critical components for GPU workload co-location and checkpointing/restoration.

This is a strong fit for someone who enjoys systems-level engineering, cares deeply about correctness, reliability, and performance, and has a strong desire to learn, improve, and explore new technologies across a cutting-edge AI infrastructure company.

Your profile

• Bachelor’s or master's degree in computer science, Electrical Engineering, Data Science, or a related field (PhD is a plus)
• Strong programming skills in Rust, especially async Rust.
• Practical experience with Tokio or similar async runtimes.
• Proficiency in data structures and algorithms.
• Experience writing distributed software with asynchronous components, managing concurrent state, avoiding deadlocks.
• Proficiency in writing system-level components, FFIs, development of unsafe components.

Nice to Have

• C++ background, especially in low-level or systems programming.
• Experience with Kubernetes APIs, operators, schedulers, or control plane components.
• Experience with Linux internals, dynamic linking, runtime interception, checkpoint/restore, or container runtimes.
• Prior work on AI infrastructure, distributed compute, HPC, or performance-sensitive backend systems.
• Experience with CUDA, GPGPU programming, or GPU performance optimization.

Why us?

• Build something big: Help build and scale a fast-growing AI infrastructure startup
• Pay & perks: Competitive compensation with a performance-based incentive, subsidized Deutschlandticket, and access to a discount portal
• Work your way: Flexible hours with hybrid and remote-friendly options
• Fast lanes, no red tape: Flat hierarchies and rapid decision-making mean ideas ship quickly
• Global team: Work with a diverse, international team across Germany and the USA
• Modern headquarters: Well-stocked office near the Heidelberg Hauptbahnhof, available on a hybrid basis or as a place to connect during our quarterly team workshops
• Top setup: Your choice of high-quality hardware and equipment
• Relocation support: We’ll help make your move to join us as smooth as possible

About Us turbalance is an innovative, emerging startup that transforms AI laws. We are a team of passionate problem-solvers who believe in what we’re building. We constantly push boundaries and embrace our inner nerds as we find new ways to tackle complex challenges. You will find a dynamic work environment here, with flat or even non-existent hierarchies and the chance to take on responsibility from day one.

Apply for this job