What You’ll Be Working On
Scope workloads, define metrics (TTFT, throughput, cost/token), build benchmarks, and lead technical POCs.
Serve as the technical lead for customer engineering teams through architecture reviews and rollout planning.
Tune engines (KV cache, speculative decoding, parallelism, quantization) to hit aggressive performance targets.
Profile and diagnose bottlenecks at the engine level to deliver production fixes.
Own end-to-end customer onboarding, deployment, autoscaling, capacity planning, and SLO monitoring.
Optimize configurations for base, custom, and fine-tuned models to accelerate time-to-value.
Feed field insights back into product roadmaps and contribute code to our inference engine and tooling.
Publish reference architectures, cookbooks, and technical blogs.
What You’ll Bring to the Team
5+ years in a technical role with strong programming and production skills (Kubernetes, Docker, GPU servers).
Proven ability to lead technical discussions with customer engineers and leadership.
Hands-on experience with inference engines (vLLM, SGLang, TensorRT-LLM) and performance profiling.
Strong command of KV-cache tuning, batching, parallelism, quantization, and related cost math.
Solid knowledge of the open-source model landscape and hardware-model matching.
Experience as an FDE, solutions engineer, or inference engineer at an AI cloud, lab, or provider.
Hands-on background in fine-tuning/post-training (LoRA, SFT, DPO) or contributions to open-source engines.
Benefits
Crusoe also offers a competitive benefits package designed to support financial security, health, and overall well-being. Our benefits are tailored to local market standards and include core offerings such as pension contributions and additional perks to support work-life balance.
Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.