WHAT YOU BRING
5+ years of software engineering, including 2+ years running ML or LLM models in production.
Hands-on production experience with at least one modern LLM serving engine: vLLM, SGLang or TensorRT-LLM.
A working understanding of inference bottlenecks (KV cache, attention, memory bandwidth, batching, parallelism), and the habit of reasoning about latency, throughput and cost in numbers.
Experience with Docker, Kubernetes and GPU instances in a public cloud.
Discipline in benchmarks and evaluation: you do not ship a model you have not measured.
Clear communication in English, with engineers and with product people.
NICE TO HAVE
Speculative decoding, multi-LoRA serving, or PEFT fine-tuning.
Contributions to vLLM, SGLang, PyTorch or similar open-source projects.
CUDA or Triton kernels, and the NVIDIA GPU stack (drivers, NCCL).
LLM routing, guardrail models, embeddings and rerankers.
Go or Rust; Terraform and Helm.
Observability for LLM systems (OpenTelemetry, Langfuse, Prometheus, Grafana).
Experience with analytics, semantic layers or text-to-SQL.
OUR STACK
Python, Kubernetes on AWS, NVIDIA GPUs, SIE (an open-source inference engine on SGLang), vLLM, PyTorch, gRPC, Langfuse, and our own evaluation harness.
ABOUT GOODDATA.AI
At GoodData.AI, we’re building the future of agentic AI for data intelligence.
Our full-stack data intelligence platform empowers companies to turn raw data into real business impact — from agentic AI apps to embedded analytics that scale securely and seamlessly. With GoodData.AI, organizations don’t just analyze data, they monetize it.
But what really sets GoodData.AI apart is our mission: to put intelligence wherever decisions are made. That’s why we’ve built a platform that’s AI-native, composable, and built for the way modern enterprises work.
#LI-Hybrid