Hewlett Packard Enterprise

Senior Software Engineer, Inference

Spring, United States · On-site
Salary not published
Posted 8 weeks ago

From Hewlett Packard Enterprise's careers page

Status: listed on the employer's own careers page when we last checked (daily). Confirm on their site before applying.

About the role

What they ask for vs. your profile

Must have

LLMs
C++
Kubernetes
Python
Root cause analysis
Scheduling

Your match

Reach the hiring team

A short note to a recruiter or the hiring manager after you apply can get your application read sooner.

Hi [Name], I just applied for the Senior Software Engineer, Inference role at Hewlett Packard Enterprise. My background in [your most relevant experience] lines up well with what the team is looking for. Would you be open to a quick chat, or could you point me to the right person on the team? Thank you!

ATS check

AI ready

Scores your resume against this job the way resume scanners do: the job's hard and soft skills, searchability, recruiter tips and formatting.

Choose a PDF or Word resume

Create a free account to see your score. Your resume stays in this browser until then, and we never store it.

Already a member? Sign in

Similar jobs

All jobs

Hewlett Packard Enterprise

Senior Software Engineer, Inference

Spring, United States · On-site
Salary not published
Posted 8 weeks ago

From Hewlett Packard Enterprise's careers page

Status: listed on the employer's own careers page when we last checked (daily). Confirm on their site before applying.

About the role

Become part of our team as a Senior Software Engineer, Inference, where you will design and implement key components of the LLM serving deployment, focusing on engine integration and distributed execution. Ideal candidates bring significant experience in LLM inference runtimes and advanced programming skills.

Skills: llm inference engines, kubernetes, gpu memory management, continuous batching, kv cache management, tensorrt-llm, vllm, sglang, nvidia nim, nccl collective operations, python, go, quantization, speculative decoding, distributed execution, c++/cuda debugging, rag, agent serving, rdma, gpudirect storage, infiniband, roce, mig, gpu allocation management, multi-tenant gpu isolation, model admission orchestration, gpu scheduling, cache-aware request routing, autoscaling, root cause analysis

What they ask for vs. your profile

Must have

LLMs
C++
Kubernetes
Python
Root cause analysis
Scheduling

What they ask for vs. your profile

Must have

LLMs
C++
Kubernetes
Python
Root cause analysis
Scheduling

Your match

A free account lets you apply, save this job, see how well you match and check your resume against it.

Career roadmap: Software EngineerWhat to learn, how to practice and free resources, from beginner to expert.

Reach the hiring team

A short note to a recruiter or the hiring manager after you apply can get your application read sooner.

ATS check

AI ready

Scores your resume against this job the way resume scanners do: the job's hard and soft skills, searchability, recruiter tips and formatting.

Choose a PDF or Word resume

Create a free account to see your score. Your resume stays in this browser until then, and we never store it.

Already a member? Sign in

ATS check

AI ready

Scores your resume against this job the way resume scanners do: the job's hard and soft skills, searchability, recruiter tips and formatting.

Choose a PDF or Word resume

Create a free account to see your score. Your resume stays in this browser until then, and we never store it.

Already a member? Sign in