Develop and maintain evaluation systems to measure model factuality, groundedness, accuracy, reliability, and compliance-related performance. Monitor, debug, and optimize production machine learning systems for accuracy, reliability, scalability, latency, and performance.
Collaborate with engineering, product, regulatory, and business teams to translate scientific, regulatory, and commercial requirements into production-ready AI solutions. In person required, M-F.
Requirements: Master's degree, or foreign equivalent, in Computer Science or a related field.
Any amount of experience in the additional requirements below will be acceptable unless a specific amount is noted. Prior academic background or work experience to include the following skills:
1) Machine learning and deep learning model development;
2) Natural language processing and large language model applications;
3) Machine learning model development and applied AI/ML engineering;
4) Python and machine learning frameworks, including PyTorch or TensorFlow;
5) Machine learning data pipeline development and processing;
6) Model evaluation, experimentation, and performance benchmarking, including
evaluation of factuality, groundedness, or accuracy;
7) Deployment of machine learning models and systems in production environments; and
8) Software debugging, testing, monitoring, and performance optimization.
Salary: $140,000 to $250,000 per year.
Job Location: New York, NY.
Email resume to jobs@solsticehealth.co and Reference Job Code #FMLE.
