Job Overview
We are seeking an experienced Senior Manager, Software Engineering to lead engineering teams building core capabilities of the ClusterWareAI platform, with strong exposure to Data Science, Machine Learning, Generative AI, and Agentic AI.
ClusterWareAI enables deployment, orchestration, monitoring, optimization, and lifecycle management of large-scale AI infrastructure. This role will lead engineering across distributed systems, Kubernetes, infrastructure orchestration, observability, and AI-enabled platform capabilities.
The ideal candidate is a strong engineering leader who can build high-performing teams, drive technical execution, and work closely with Data Science and AI teams to productionize intelligent capabilities.
As a Senior Engineering Manager, you will provide technical and organizational leadership, drive execution across multiple initiatives, develop engineering leaders, and help establish Bangalore as a key engineering center for ClusterWareAI.
Responsibilities
Lead, grow, and develop high-performing software engineering teams responsible for key components and services within the ClusterWareAI platform.
Drive roadmap execution across multiple engineering initiatives from architecture and design through development, validation, release, and production support.
Partner with Product Management, Principal Engineers, and Architects to define technical strategy, architecture, and execution priorities aligned with product and customer requirements.
Partner with Data Science and AI teams to productionize ML models, analytics, GenAI, and agentic capabilities.
Establish engineering practices for AI/ML reliability, observability, security, evaluation, and governance.
Provide technical leadership for large-scale distributed systems and cloud-native platform capabilities spanning infrastructure orchestration, cluster management, APIs, Kubernetes, and AI infrastructure.
Guide architectural decisions and technical trade-offs related to scalability, availability, performance, security, maintainability, and operational complexity.
Drive the development of reliable control-plane services and APIs for provisioning, orchestration, monitoring, and lifecycle management of large-scale AI infrastructure.
Champion engineering excellence through strong software architecture, code quality, test automation, CI/CD, observability, security, resiliency, and operational practices.
Build platforms designed for large-scale and multi-tenant environments, with strong consideration for isolation, resource governance, high availability, failure recovery, and non-disruptive lifecycle operations.
Establish measurable engineering and operational goals covering delivery predictability, product quality, reliability, performance, and engineering productivity.
Partner with Quality Engineering, Support, and customer-facing teams to resolve complex field issues, drive root-cause analysis, and translate customer learnings into product and engineering improvements.
Recruit, mentor, and retain strong engineering talent while developing senior engineers and technical leads into broader technical and organizational leadership roles.
Create an environment of ownership and accountability where teams can make effective technical decisions and deliver customer outcomes with appropriate autonomy.
Champion AI-assisted software development practices across the engineering organization, including the effective use of AI coding assistants and agentic development tools for design, implementation, testing, code review, debugging, documentation, and developer productivity, while establishing appropriate quality, security, and governance practices.
Drive continuous improvement in developer experience and engineering productivity through modern development environments, automation, AI-assisted workflows, and measurable engineering practices.
Identify dependencies and risks across engineering teams and drive alignment and resolution across organizational boundaries.
Communicate engineering strategy, execution status, technical trade-offs, risks, and outcomes effectively to senior engineering and business leadership.
Collaborate closely with globally distributed teams while continuing to build ClusterWareAI engineering capability and technical expertise in Bangalore.
Evaluate and adopt AI-assisted software development approaches that improve engineering productivity while maintaining appropriate architecture, review, security, and quality standards.
Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
15+ years of software engineering experience building enterprise software, distributed systems, cloud platforms, or infrastructure software with Practical exposure to Data Science, ML, GenAI, or AI/ML platforms.
5+ years of engineering leadership experience, with a demonstrated ability to lead and develop high-performing software engineering teams.
Experience leading multiple engineering initiatives, teams, or technical workstreams for a complex commercial software product or platform.
Understanding of LLMs, RAG, AI agents, model serving, evaluation, and ML lifecycle.
Ability to work effectively with Data Scientists and ML/AI Engineers.
Experience using AI-assisted development tools and workflows.
Strong technical depth in distributed systems, cloud-native architectures, microservices, APIs, and infrastructure software.
Strong understanding of Kubernetes, containers, Linux, REST/gRPC APIs, and modern service architectures.
Experience designing and delivering highly available, scalable, resilient, and secure production software.
Strong understanding of modern software engineering practices including architecture and design reviews, Agile development, automated testing, CI/CD, DevOps, observability, and production operations.
Ability to engage deeply in architecture and technical design discussions and provide effective guidance on complex engineering decisions.
Experience owning software through the complete lifecycle—from requirements and architecture through development, deployment, operation, and continuous improvement.
Demonstrated ability to recruit, coach, mentor, and develop senior engineers and technical leaders.
Demonstrated experience adopting AI-assisted software development tools and workflows, with an understanding of how to apply them effectively while maintaining code quality, security, architectural integrity, and engineering accountability.
Strong customer and product mindset with the ability to translate customer requirements and operational challenges into engineering priorities.
Experience collaborating effectively across Product Management, Architecture, Quality Engineering, Support, and other engineering organizations.
Excellent communication, collaboration, and stakeholder-management skills, including experience working with globally distributed teams.
Preferred Qualifications
Experience with one or more of the following
AI infrastructure, GPU cloud/neocloud platforms, or large-scale cloud infrastructure.
Building cloud control planes, infrastructure management platforms, or orchestration systems.
Kubernetes platform engineering and large-scale container orchestration.
GPU infrastructure, heterogeneous accelerator environments, or GPU resource management.
Bare-metal provisioning, fleet management, and infrastructure lifecycle automation.
Multi-tenant platforms, resource scheduling, quotas, isolation, and infrastructure security.
High-performance networking technologies including InfiniBand, RDMA/RoCE, and high-speed Ethernet.
Distributed storage and data infrastructure.
Infrastructure automation and Infrastructure as Code technologies such as Ansible.
Observability, Site Reliability Engineering practices, service-level objectives, high availability, and automated remediation.
Workload management and scheduling technologies such as Kubernetes and Slurm.
Hybrid cloud and enterprise SaaS platforms.
High Performance Computing environments.
AI/ML platform infrastructure, LLM infrastructure, or AI-enabled infrastructure operations.
Building or scaling engineering teams within a growing product or engineering organization.
Location
Hybrid – Bangalore, India
Travel
Less than 10%
Apply now »
Find similar jobs
CAREER OVERVIEW
VIEW ALL JOBS
TOP JOB SEARCHES
CONNECT WITH US
Opens in a new tab.
Opens in a new tab.
Opens in a new tab.
Opens in a new tab.
Copyright © 2025 Penguin Solutions®. All Rights Reserved.
