Additional Responsibilities
Measure and characterize large language model (LLM) inference workloads on state-of-the-art GPU hardware, including how they behave when parts of the system fail or degrade.
Build prototypes, simulators, or models that test new ideas in serving systems, fault tolerance, GPU communication, or AI hardware.
Compare new approaches against existing methods.
Document findings and prepare results for publication at top-tier venues.
Present the work to technical audiences, both internally and externally.
Qualifications
Required Qualifications
Currently enrolled in a Doctorate Degree program in Computer Science, Artificial Intelligence, Machine Learning, or a related STEM field.
Other Requirements
Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.
Preferred Qualifications
Research experience in computer systems, distributed systems, networking, or computer architecture and hardware design.
Proficient programming skills in C/C++ and Python.
Working knowledge of ML/AI/LLM concepts.
Experience designing experiments and writing research papers.
Candidates should have depth of expertise in one or two of the following areas:
Experience with GPU microarchitecture, performance modeling, or architectural simulators.
Experience with CUDA, RDMA/verbs, or GPU collective communication libraries (e.g., NCCL, MSCCL++, DeepEP).
Familiarity with LLM inference systems and serving stacks, including MoE models and expert parallelism.
Experience measuring system performance at scale on real hardware.
Prior work on fault tolerance or distributed ML systems.
Publications at venues such as ISCA, MICRO, ASPLOS, HPCA, MLSys, OSDI, SOSP, NSDI, SIGCOMM, EuroSys, or ML venues such as NeurIPS and ICML.
Ability to work both independently and collaboratively in a fast-moving research environment.
Intern - MSR- The typical base pay range for this role across Canada is CAD $9,150 - CAD $10,170 per month.
Find additional pay information here:https://careers.microsoft.com/v2/global/en/canada-pay-information.html
Microsoft accepts applications and processes offers for these roles on an ongoing basis throughout the academic calendar (September - April).
Ce poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.