Lead, Product Content Engineering - Creative Evals

Los Angeles, United States · On-site
Salary not published
Posted 6 weeks ago

From Meta's careers page

Status: listed on the employer's own careers page when we last checked (daily). Confirm on their site before applying.

About the role

You will own the human evaluation layer that tells our models what quality means, designing the rubrics, running the eval rounds, and turning subjective creative judgment into reproducible, measurable signals that directly shapes model behavior and launch decisions.

What they ask for vs. your profile

Must have

LLMs

Your match

Reach the hiring team

A short note to a recruiter or the hiring manager after you apply can get your application read sooner.

Hi [Name], I just applied for the Lead, Product Content Engineering - Creative Evals role at Meta. My background in [your most relevant experience] lines up well with what the team is looking for. Would you be open to a quick chat, or could you point me to the right person on the team? Thank you!

ATS check

AI ready

Scores your resume against this job the way resume scanners do: the job's hard and soft skills, searchability, recruiter tips and formatting.

Choose a PDF or Word resume

Create a free account to see your score. Your resume stays in this browser until then, and we never store it.

Already a member? Sign in

Similar jobs

All jobs

Lead, Product Content Engineering - Creative Evals

Los Angeles, United States · On-site
Salary not published
Posted 6 weeks ago

From Meta's careers page

Status: listed on the employer's own careers page when we last checked (daily). Confirm on their site before applying.

About the role

Product Content Engineering is a horizontal function supporting initiatives across Instagram and Meta AI, and is seeking a content engineer to lead media generation evaluations. We partner closely with product, research and modeling teams to set standards of quality and define what “good” looks like for generative image and video experiences.

This position is focused on model training for image and video generation capabilities. You will own the human evaluation layer that tells our models what quality means, designing the rubrics, running the eval rounds, and turning subjective creative judgment into reproducible, measurable signals that directly shapes model behavior and launch decisions.

The ideal candidate has built video and image evaluation rubrics from scratch and has hands-on video production expertise — they can articulate why a generated clip fails on motion coherence, lighting continuity, subject consistency, pacing, framing or audio sync, and can write that judgment down so that dozens of raters apply it the same way. They are fluent in text-to-video, image-to-video and video-to-video generation, and in the failure modes specific to each.

You will operate as the quality authority across multiple modeling workstreams: setting the taxonomy, arbitrating disagreement, calibrating rater pools, and translating eval results into clear guidance for researchers and product leaders. You will also drive where human evaluation should give way to automated or LLM-as-a-judge measurement, and prove out that transition with data.

What they ask for vs. your profile

Must have

LLMs

What they ask for vs. your profile

Must have

LLMs

Your match

A free account lets you apply, save this job, see how well you match and check your resume against it.

Reach the hiring team

A short note to a recruiter or the hiring manager after you apply can get your application read sooner.

ATS check

AI ready

Scores your resume against this job the way resume scanners do: the job's hard and soft skills, searchability, recruiter tips and formatting.

Choose a PDF or Word resume

Create a free account to see your score. Your resume stays in this browser until then, and we never store it.

Already a member? Sign in

ATS check

AI ready

Scores your resume against this job the way resume scanners do: the job's hard and soft skills, searchability, recruiter tips and formatting.

Choose a PDF or Word resume

Create a free account to see your score. Your resume stays in this browser until then, and we never store it.

Already a member? Sign in