What Is Azure AI Infrastructure?
High scale AI workloads are always testing the limits of the infrastructure stack. Large-scale model training and inference with huge data volumes of training data on hundreds-thousands of GPUs make it a true engineering challenge. Azure AI Infrastructure is a globally distributed, multi-tenant service that provides robust, cost-effective AI infrastructure (compute, networking and storage) for AI training and inferencing. By abstracting workloads from underlying infrastructure, Azure AI Infrastructure creates a shared pool of resources that can be dynamically provisioned for full utilization of expensive GPU compute, and enabling data scientists to productively build, scale, experiment, and iterate their models on top of a robust, performant, scalable and cost-effective distributed infrastructure built for AI. In Azure AI Infrastructure, we are constantly seeking to apply the ideas from AI, ML, distributed systems, distributed databases, machine learning, information retrieval, networking, and security.
Responsibilities
Work on the architecture, design, and development of the AI Infrastructure services that support large scale AI training and inferencing
Develop, test, and maintain backend services written in C#, Go, Rust, C++, hosted on Kubernetes
Enhance systems and applications to ensure robustness, efficiency, maintainability, low latency, tight cloud security
Provide operational support and DRI responsibilities for the product
Develop and foster a deep understanding of the machine learning systems and concepts and their usage by our customers
Collaborate closely with engineers, data scientists within the team, internal Microsoft Research teams and external enterprises to build better solutions together
Provide vision, expertise, and technical leadership to other team members
Help to grow talent in these areas
Qualifications
Required Qualifications
- A master’s or bachelor’s degree in computer science or a related field
- 10+ years of experience with coding in one of C#, C or C++, Rust, go
Experience working with the Linux operation system, Kubernetes Networking, SDN, and Kubernetes cluster orchestration
Experience with improving service operations or engineering fundamentals
Collaboration skills
Experience building and shipping production software or services
Preferred Qualifications
Master's Degree or Ph.D. in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
Experience in development in the Kubernetes ecosystem
Experience working on cloud infrastructure including compute, networking, storage, and identity services
Experience in working on Kubernetes Networking and Software Defined Networking systems
Experience in building large scale cloud services, distributed systems, or operating systems
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.