Guided search and reinforcement learning for agentic systems
Reinforcement learning for reasoning models
Web-scale problem collection for training agents
Efficient model distillation
Some examples of what your responsibilities might include are
Conducting experiments to figure out efficient ways to train a large language model on traces of interactions with various environments
Exploring methods of guided generation and search in the trajectory space
Coming up with ways to mine relevant data at web scale and figuring out efficient ways to use this data in model post-training
Conducting experiments with different reinforcement learning configurations in verifiable domains
Exploring methods to train AI agents on tasks with non-verifiable reward signals
We expect you to have
A profound understanding of theoretical foundations of machine learning and reinforcement learning
Deep expertise in modern deep learning for language processing and generation
Substantial experience with training large models on multiple computational nodes
Strong software engineering skills (we mostly use python)
Deep experience with modern deep learning frameworks (we use jax)
Strong communication and leadership abilities
Experience designing, executing, and analyzing machine learning experiments with proper statistical rigor
Ability to formulate research questions, design experiments to test hypotheses, and draw meaningful conclusions from results
Ability to document research findings clearly and contribute to technical publications or report
Nice to have
Experience with deep reinforcement learning for LLMs, including techniques such as reward modeling, DPO, PPO etc
Familiarity with important ideas in LLM space, such as RoPE, ZeRO/FSDP, Flash Attention, quantization
Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, or a related field Master’s or PhD preferred
Track record of building and delivering products (not necessarily ML-related) in a dynamic startup-like environment
Experience in engineering complex systems, such as large distributed data processing systems or high-load web services
Open-source projects that showcase your engineering prowess
Excellent command of the English language, alongside superior writing, articulation, and communication skills
Proficiency in contemporary software engineering approaches, including CI/CD, version control and unit testing
Benefits & Perks
Competitive compensation
Career growth and learning opportunities
Flexibility and ownership
Collaborative and innovative culture
Opportunity to work on impactful AI projects
International environment and talented teams
What’s it like to work at Nebius
Fast moving – Bold thinking – Constant growth – Meaningful impact – Trust and real ownership – Opportunity to shape the future of AI
Equal Opportunity Statement
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
If you need accommodations during the application process, please let us know.