WHAT YOU'LL ACCOMPLISH
Data Mix and Quality Uplift: Design and iterate on high-quality data mixtures for late-stage and annealing training runs. Develop principled methods for sourcing, filtering, and weighting data to sharpen model capabilities without degrading general performance.
Capability Injection: Drive targeted improvements in coding, mathematics, and long-horizon reasoning through curated data strategies and training interventions. Translate research insights into measurable capability gains on our agents.
Synthetic Data Research: Develop and evaluate synthetic data pipelines that generate training signal at scale. Understand the limits and failure modes of synthetic approaches and build methods that hold up in production training runs.
Annealing and Schedule Design: Research and optimize multi-stage learning rate schedules, warmup strategies, and compute allocation across training phases. Understand how schedule choices interact with data distribution and model behavior.
Context Length Extension: Research and implement methods for extending effective context length without degrading short-context performance. This includes positional encoding strategies, data construction, and targeted evaluation.
Evaluation and Iteration: Build evals that distinguish real capability improvements from benchmark overfitting. Close the loop between training decisions and what actually matters for Devin and our other systems in deployment.
Scaling and Methodology: Measure how mid-training interventions scale with compute and data. Develop new approaches when existing methods hit ceilings; we expect both rigorous empiricism and original thinking.
EXCEPTIONAL CANDIDATES HAVE DEMONSTRATED
Deep familiarity with the LLM training pipeline end to end: pre-training data, optimization, architecture, and how mid-training and post-training interact
Hands-on experience with continual pre-training, annealing, or late-stage data mixing for large models
Strong intuition for data quality: what makes a dataset useful for training, how to filter and curate at scale, and how data mix choices compound across evals
Experience developing or evaluating synthetic data pipelines for capability improvement
Proficiency in Python and deep learning frameworks (PyTorch); comfortable debugging distributed training at scale
Strong fundamentals in optimization, statistics, and ML theory; able to distinguish real effects from noise, instability, and overfitting
A track record of original contributions: publications, open-source impact, or internal results that moved a capability frontier
Comfort operating in ambiguous, fast-moving environments where the problem definition is as important as the solution
We care more about demonstrated capability than credentials. A PhD is one signal among many.
RESOURCES & ENVIRONMENT
Small, highly selective team where research and product move together; prototypes reach real deployment quickly
Compute is not a constraint: large allocations with training jobs routinely running across thousands of GPUs from day one
The environment rewards speed, autonomy, and technical depth with minimal process overhead; this is one of the most competitive and fast-moving problems in AI
OUR COMMITMENT
Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.
Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice https://cognition.com/documents/Cognition-Global-Applicant-and-Job-Candidate-Privacy-Notice.pdf. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement https://cognition.com/documents/Cognition-Applicant-Arbitration-Agreement.pdf.
