This is a full-time position tailored for a problem-solving engineer who thrives in ambiguity and has a strong bias toward shipping. You will tackle rare infrastructure challenges—such as energy-aware compute scheduling, closed-loop remediation, and failure prediction on noisy hardware telemetry—transforming complex operational signals into a single, programmable control plane. If you are excited to build foundational infrastructure that turns tens of thousands of accelerators across sites into one cohesive, logical system, this role offers an unprecedented opportunity to do the most meaningful work of your career.
KEY RESPONSIBILITIES
Core Responsibilities: Design, build, and operate greenfield distributed services, control planes, and closed-loop remediation systems that automatically drain, checkpoint, replace, and resume live AI workloads without manual intervention.
Communication & Collaboration: Partner closely with staff and principal engineers to review architectures, establish safety rails for autonomous operations, and share technical knowledge across the cloud services team.
Daily Interactions: Collaborate daily with cross-functional partners spanning hardware engineering, energy management, data center construction, and customer support to align system design with physical infrastructure.
Key Contributions: Own the development of core platform features such as unified observability pipelines, energy-aware compute scheduling, straggler detection, and self-qualifying hardware pipelines to maximize overall system goodput.
WHAT YOU’LL BRING TO THE TEAM
Production Systems Experience: Minimum of 2+ years of experience building, shipping, and operating backend or infrastructure systems in production (e.g., distributed services, control planes, schedulers, or observability pipelines).
Distributed Systems Foundations: Demonstrated mastery of state reconciliation, retries and idempotency, consistency tradeoffs, and autonomous automation on live infrastructure.
Systems Programming Proficiency: Strong engineering fundamentals using a modern systems language such as Go, Rust, or C++.
Problem-Solving & Ownership: High comfort level working through ambiguous problem statements, proposing clear designs, and driving features from concept to production.
Shipping Mindset: A strong bias toward action and iterative delivery, favoring practical production software over over-engineered documentation.
Educational Background: Bachelor's degree or equivalent practical experience in Computer Science, Engineering, or a related technical discipline.
BONUS POINTS
Hardware & HPC Familiarity: Hands-on experience or deep familiarity with GPU health telemetry, NVLink/InfiniBand/RoCE networking fabrics, or hardware thermal and power behavior.
Observability Architecture: Prior experience designing scalable observability and telemetry pipelines that span compute, storage, and networking layers.
Scheduler Internals: Familiarity or direct exposure to Kubernetes internals, Slurm, or other distributed orchestrator ecosystems.
Statistical Methods & ML: Experience applying statistical methods, anomaly detection, or time-series forecasting to noisy operational data for predictive maintenance.
Zero-Trust Security: Knowledge of zero-trust architectures, policy-based access systems, or automated multi-tenant audit streaming.
BENEFITS
Crusoe also offers a competitive benefits package designed to support financial security, health, and overall well-being, including pension contributions, private health and dental insurance, income protection, life assurance, and more.
COMPENSATION
Compensation will be paid as a salary or hourly. Compensation to be determined by the applicant’s education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data.
Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.
