Evaluate when to use LLMs versus smaller task-specific models based on accuracy, latency, throughput, and cost.
Optimize models for production using quantization, distillation, batching, model compilation, and efficient inference frameworks.
Develop multilingual NLP models and cross-lingual approaches for global labor market data.
Design robust evaluation frameworks, perform error analysis, and continuously improve model quality.
Partner with ML and data engineers to deploy scalable models and training pipelines in AWS.
Stay current with advances in NLP, LLMs, embeddings, and efficient machine learning, and translate promising research into production systems.
- Mentor team members and contribute to technical standards and modeling strategy.
- Education and Experience:
- Master's degree or PhD in Computer Science, Machine Learning, NLP, or a related field.
Strong experience building and deploying production NLP or ML systems.
Deep understanding of transformers, embeddings, classification, information extraction, and entity normalization.
Strong Python and PyTorch experience; hands-on experience with Hugging Face or similar frameworks.
Experience with large-scale model training, evaluation, and productionization.
Strong problem-solving skills and ability to independently drive ambiguous ML problems from research to production.
Hands-on experience fine-tuning LLMs or foundation models.
Experience with LoRA, QLoRA, PEFT, instruction tuning, or model distillation.
Experience with model inference optimization, including quantization, ONNX, TensorRT, vLLM, TorchCompile, or GPU optimization.
Experience with multilingual NLP, semantic search, retrieval, entity linking, or knowledge graphs.
Experience with AWS, SageMaker, Docker, MLflow, or similar MLOps tooling.