Profile inference pipelines to identify and eliminate bottlenecks in latency, memory bandwidth, and power consumption.
Optimize kernel scheduling, memory layout, and data movement across the compute hierarchy.
Partner closely with the AI/ML team to define model architecture constraints that are hardware-friendly from the outset.
Work with the Platform Software team on runtime integration, scheduling, and power management.
Engage with silicon vendors and research teams to track the accelerator landscape and influence hardware roadmaps.
Requirements
M.S. or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or a related field — or equivalent industry experience.
At least 8 years of industry experience in hardware acceleration, ML systems, or compute architecture.
Deep understanding of AI/ML inference — model formats (ONNX, TFLite, etc.), inference runtimes, and deployment pipelines.
Hands-on experience optimizing models for edge or embedded hardware using quantization, pruning, and operator-level tuning.
Strong understanding of computer architecture — memory hierarchies, data movement, and heterogeneous compute.
Experience profiling and benchmarking inference workloads across CPU, GPU, NPU, DSP.
Familiarity with low-level toolchains and compilation frameworks (e.g. TVM, MLIR, TensorRT, Torch, SNPE/QNN, JAX, CUDA, ROCm).
Solid software engineering skills in C++ and Python.
Strong cross-functional communication skills — able to work effectively across hardware, software, and AI/ML teams.
Bonus Qualifications
Knowledge of real-time operating constraints and their impact on inference scheduling.
Track record of co-designing model architectures with ML teams to meet hardware constraints.
The US base salary range for this full-time position is $180,000 to $275,000 per year.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.