Develop observability for model quality, latency, cost, drift, safety, and customer impact.
Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products.
Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization.
Define reusable standards for AI quality, monitoring, safety, and operational readiness.
Required Qualifications
Bachelor's degree in Computer Science, Software Engineering, Data Science, or related field
8+ years of software engineering, ML engineering, or AI platform experience
Experience evaluating, deploying, or monitoring production AI systems
Strong Python and data engineering skills
Experience with offline/online evaluation, data quality, model monitoring, or observability systems
Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails
Strong communication skills and ability to set standards across teams
Preferred Qualifications
Experience with LLM-as-judge, agent tracing, multimodal evals, golden datasets, or automated regression suites
Experience with GCP/AWS, Vertex AI, SageMaker, MLflow, Datadog, OpenTelemetry, Private Cloud or similar tooling
Experience with privacy-aware AI systems, customer trust metrics, or launch-readiness processes
Experience supporting computer vision, GenAI, recommendation, or edge AI products
Experience building developer platforms or internal AI tooling
Working at Vivint
Learn about the Vivint Culture and why it’s a great place to grow your career!
Here are some highlighted perks you should ask us about
Free daily lunch and drinks on site
Paid holidays and flexible paid time away
Employee/Friends/Family Discounts
Onsite health clinic, gym, gaming tables
Medical/dental/vision/life coverage & 24/7 Medical Hotline
401(k) + Employer Match
Employee Resource Groups
Quarterly Innovation Weeks
WORKING CONDITIONS
This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines.
SAFETY
Vivint enforces a safety culture whereby all employees have the responsibility for continuously developing and maintaining a safe working environment. Each new employee is responsible for completing all training requirements. Additionally, the employee must accept they have responsibility for maintaining the safety of themselves, their co-workers, and the public. Employee must adhere to all written and verbal instructions, promptly report and correct all hazards or unsafe conditions, question non-standard operations or unmitigated hazards, and provide feedback to management on all safety issues.
We support the use of AI tools to help you prepare for your interview (e.g., practicing responses, researching the role, or refining your resume). However, during interviews and assessments, we expect responses to reflect your own thinking, experience, and communication. Use of AI to generate or read answers in real time, complete assessments, or misrepresent your qualifications is not permitted and may impact your candidacy.
NRG Energy is committed to a drug and alcohol-free workplace. To the extent permitted by law and any applicable collective bargaining agreement, employees are subject to periodic random drug testing, and post-accident and reasonable suspicion drug and alcohol testing. EOE AA M/F/Vet/Disability. Level, Title and/or Salary may be adjusted based on the applicant's experience or skills.
Official description on file with Talent.
We support the use of AI tools to help you prepare for your interview (e.g., practicing responses, researching the role, or refining your resume). However, during interviews and assessments, we expect responses to reflect your own thinking, experience, and communication. Use of AI to generate or read answers in real time, complete assessments, or misrepresent your qualifications is not permitted and may impact your candidacy.