Improve the tooling that is used internally to implement, run and analyze evaluations.
Design internal benchmarking and regression testing capabilities that capture model accuracy, safety and utility.
Qualifications
Required Qualifications
Bachelor's or Higher Degree in Computer Science, or related technical discipline AND significant Python programming experience / machine learning research.
Experience building with and around LLMs including prompt / context and harness engineering.
Deep expertise in evaluating and understanding the performance of agents.
Experience collaborating in cross functional teams, working through ambiguity to deliver high quality results.
Have 0 to 1 experience with a bias towards shipping and learning, while balancing a high-quality bar.
Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.
Preferred qualifications
Experience in healthcare technology, or experience in the health domain.
Experience with data engineering - handling text dataset sourcing, curation, and processing tasks at scale.
Demonstrated written and verbal communication skills with the ability to work closely with cross-functional teams, including product managers, designers, and other engineers.
Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies and patterns in AI.
Software Engineering IC5 - The typical base pay range for this role across United Kingdom is £ 93,500.00 - £ 161,800.00 per year. Certain roles may be eligible for benefits and other compensation.
Find additional benefits and pay information here
https://careers.microsoft.com/v2/global/en/corporate-pay/united-kingdom-corporate-pay.html
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.