Location: Remote
Work Hours: This position requires working online from 8:00 AM Eastern to 5:00 PM Eastern
Day to Day Roles and Responsibilities
Incident Response and Troubleshooting
Serve as the Tier 3 escalation point for complex incidents and outages across the Azure Kubernetes Service (AKS) and ARK agentic-runtime environment
Lead investigation and resolution of issues across the Kubernetes stack including AKS clusters, the control plane, CNI networking, ingress, CSI storage, and workload scheduling, as well as the ARK control plane and its Custom Resources (Agents, Models, Teams, Tools, and Queries)
Drive root cause analysis on high-severity incidents and own implementation of solutions to prevent recurrence
Manage high-priority incident communications with stakeholders, leadership, and affected tenants
Platform Monitoring and Optimization
Define and enforce observability standards across tenant clusters using Azure Monitor, Managed Prometheus, Container Insights, Azure Log Analytics, and OpenTelemetry, including the agent-level telemetry emitted by ARK
Lead proactive identification and mitigation of cluster, node-pool, and workload risks before they impact tenants
Analyze performance, cost, and capacity trends and architect optimizations to improve stability, efficiency, and security at scale
Kubernetes and ARK Platform Engineering
Lead management and maintenance of Azure Kubernetes Service (AKS) clusters and the ARK agentic runtime across a 70+ tenant environment
Deploy, upgrade, and operate ARK on Kubernetes — managing its CRDs, controllers, and model and tool integrations (including MCP servers) to host AI agents declaratively and provider-agnostically
Ensure all tenant resources are secure, FedRAMP compliant, and continuously optimized, enforcing Kubernetes RBAC, network policy, and Azure workload identity
Partner with the Architecture team to design solutions aligned with the Azure Well-Architected Framework and Kubernetes best practices, and own and enforce Change Management procedures across the team
Collaboration, Mentorship, and Knowledge Sharing
Serve as technical lead for incident intake, triage prioritization, and team workload management
Mentor and train Tier 2 engineers on Kubernetes and agentic-runtime operations; lead knowledge transfer sessions to build team capability
Drive improvements in team metrics and service delivery in coordination with the Service Delivery Manager and Product Owner
Maintain comprehensive documentation of incident response procedures, architecture decisions, and lessons learned
Qualifications
Basic Qualifications
Bachelors degree and 8 years of experience or a Masters degree and 6 years of experience or an Associates degree and 10 year of experience or a High School diploma/equivalent and 12 years of experience.
Must be a U.S. Citizen with the ability to obtain and maintain a DHS Public Trust clearance.
Engineering and systems analysis experience, with a deep hands-on focus on Kubernetes in production
Extensive hands-on expertise operating Azure Kubernetes Service (AKS) and the broader Kubernetes stack — control plane, CNI networking, ingress, CSI storage, RBAC, Helm, and workload scheduling
Hands-on experience deploying and operating Agentic Runtime for Kubernetes (ARK) or comparable Kubernetes-native agent or operator platforms built on the CRD-plus-controller pattern (e.g., Argo), including ARK Custom Resources (Agents, Models, Teams, Tools, and Queries) and MCP/A2A integration
Proven experience leading incident management and root cause analysis in large-scale, multi-tenant government environments, with deep knowledge of FedRAMP compliance and Kubernetes and Azure security best practices
Strong leadership, communication, and technical documentation skills; ability to communicate effectively with both technical teams and senior stakeholders
Preferred Qualifications
Certified Kubernetes Administrator (CKA) or Certified Kubernetes Application Developer (CKAD), plus Microsoft Azure Administrator Associate (AZ-104) or Microsoft Azure Solutions Architect Expert (AZ-305)
Proficiency with GitOps and Infrastructure as Code (Terraform, Bicep, Helm, and Argo CD or Flux) and CI/CD pipelines (Azure DevOps or GitHub Actions)
Advanced scripting with Python, PowerShell, or Go for automation and remediation, including use of the ARK Python SDK (ark-sdk)
Experience integrating LLM providers (Azure OpenAI, Anthropic, Google, or local models) behind an agentic runtime
Target Salary Range $104,000 - $166,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.
Benefits Statement
Peraton offers eligible employees a variety of benefits including medical, dental, vision, life, health savings account, short/long term disability, EAP, parental leave, 401(k), paid time off (PTO) for vacation, and company paid holidays. A full listing of available benefits can be viewed at https://www.careers.peraton.com/benefits.
Application Statements The application period for the job is estimated to be 30 days from the job posting date. However, this timeline may be shortened or extended depending on business needs and the availability of qualified candidates. By applying to this job, you are expressing interest in the role and the Company. During the review of your application, you may be required to participate in an on-camera interview, as well as participate in a process to verify your identity. Use of artificial intelligence (AI) tools of any kind during Peraton interviews is strictly prohibited unless the candidate has obtained prior written authorization. All interview responses must be the candidate’s own.
- EEO
- EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.
