What You’ll Do
Architect and help build and operate a scalable developer enablement platform for deploying AI/ML models into high-throughput production applications, accelerating the end-to-end lifecycle of AI-enabled applications.
Define reusable patterns for model training, feature store integration, batch/real-time inference, and pipeline orchestration using Databricks, Airflow, and cloud-native services.
Ensure ML infrastructure is built on standardized IaC to ensure repeatable, multi-environment deployments across AWS accounts.
Lead the evolution of serverless and containerized ML execution environments, migrating high-scale serverless pipelines (AWS Lambda) to Kubernetes (EKS) microservices where appropriate.
Drive CI/CD and GitOps standards for automated model delivery, champion deployment strategies, and infrastructure-as-code automation.
Design comprehensive observability and monitoring capabilities using DataDog to track model drift, latency, error rates, and system health in production.
Implement LLMOps and AIOps frameworks to manage, deploy, evaluate, and monitor Large Language Models (LLMs) and generative AI solutions, leveraging MLflow for tracking, experiment management, and model registry.
Partner closely with Data Science, Product Development, and Security teams to ensure models and AI applications are secure, compliant, and cost-efficient.
Apply security best practices to protect sensitive data and ensure compliance.
Provide technical leadership and mentorship across MLOps and engineering teams, codifying best practices in system architecture and operational excellence.
What We’re Looking For
8+ years of experience in DevOps, MLOps, Software Engineering, or Cloud Architecture with proven experience delivering and operating AI/ML systems at scale.
Deep expertise in Python and software engineering principles for production-grade microservices, SDKs, and data pipelines.
Proven architectural experience with patterns across the full ML lifecycle: training, batch/real-time inference, model registration, and application integration.
Strong proficiency with container orchestration (Kubernetes/EKS), serverless architectures (Lambda), and cloud infrastructure (AWS).
Hands-on experience with ML and LLM frameworks such as MLflow, SageMaker, PyTorch, or Spark; experience with Databricks is a plus.
Mastery of Infrastructure as Code (Terraform) and CI/CD/GitOps tooling.
Demonstrated capability in establishing enterprise observability standards using DataDog or similar platforms.
Strong leadership, communication, and cross-functional collaboration skills with a focus on developer enablement and mentoring.
This role is hybrid. On-call participation may be required to support production systems.
If you're excited about bringing machine learning to life through clean code, automation, and infrastructure excellence, we want to talk.
ModMed Benefits Highlight: At ModMed, we believe it’s important to offer a competitive benefits package designed to meet the diverse needs of our growing workforce. Eligible Modernizers can enroll in a wide range of benefits:
United States
Comprehensive medical, dental, and vision benefits, including a company Health Savings Account contribution,
401(k): ModMed provides a matching contribution each payday of 50% of your contribution deferred on up to 6% of your compensation. After one year of employment with ModMed, 100% of any matching contribution you receive is yours to keep.
Generous Paid Time Off and Paid Parental Leave programs,
Company paid Life and Disability benefits, Flexible Spending Account, and Employee Assistance Programs,
Company-sponsored Business Resource & Special Interest Groups that provide engaged and supportive communities within ModMed,
Professional development opportunities, including tuition reimbursement programs and unlimited access to LinkedIn Learning,
Global presence and in-person collaboration opportunities; dog-friendly HQ (US), Hybrid office-based roles and remote availability for some roles,
Weekly catered breakfast and lunch, treadmill workstations, Zen, and wellness rooms within our BRIC headquarters.
PHISHING SCAM WARNING: ModMed is among several companies recently made aware of a phishing scam involving imposters posing as hiring managers recruiting via email, text and social media. The imposters are creating misleading email accounts, conducting remote "interviews," and making fake job offers in order to collect personal and financial information from unsuspecting individuals. Please be aware that no job offers will be made from ModMed without a formal interview process, and valid communications from our hiring team will come from our employees with a ModMed email address (first.lastname@modmed.com). Please check senders’ email addresses carefully. Additionally, ModMed will not ask you to purchase equipment or supplies as part of your onboarding process. If you are receiving communications as described above, please report them to the FTC website.
