Build and own the evaluation harness: ground-truth datasets drawn from historical incidents, accuracy, precision and recall metrics, regression tests, and hallucination and error detection - so every change to an agent is measured before it ships.
Define the reasoning guardrails: what an agent may conclude and propose, how confident it must be, and when it must defer to a human - the quality side of the approval gate.
Turn tacit operational knowledge into machine-usable context: work with the existing domain experts to convert their runbooks and past investigations into retrievable knowledge the agent can cite.
Run the transformation on Operational workflows: take a classic operational process, redesign it with the domain owner as an agent-assisted flow, pilot it, and measure toil and MTTR reduction.
Continuously tune agent quality against production results, feeding misses back into prompts, context and the evaluation sets.
Collaborate with SRE, Ops, Platform teams, AI Ops Platform Engineers, AI Ops Site Reliability Engineers, and other stakeholders to align operational requirements, platform capabilities, automation strategies, and execution priorities
QUALIFICATIONS
Bachelor's degree in a technical field or equivalent practical experience.
4 years+ in software, data or ML/AI engineering, including hands-on delivery of LLM or agent-based applications in production.
Demonstrated prompt and context engineering, and experience building structured evaluations for AI systems (ground-truth sets, metrics, regression testing; LLM-as-judge a plus).
Working knowledge of agent frameworks and tooling (for example Amazon Bedrock AgentCore or LangGraph) and RAG / knowledge-base design, with strong Python.
IT operations literacy to design realistic operational workflows and judge the plausibility of agent output. You do not need to be a domain administrator - you will partner with domain experts who are.
Strong analytical and communication skills to work with SREs, extract knowledge and present accuracy results credibly. Familiarity with ServiceNow, Dynatrace or observability data is a plus.
Demonstrated experience in an agile work environment possessing qualities such as a collaborative mindset, adaptability to change, and a proactive problem-solving approach.
NON-STANDARD WORK SCHEDULE, TRAVEL OR ENVIRONMENT REQUIREMENTS
Periodic international and domestic travel required (less than 10%)
Please apply by sending your CV in English.
Work Location Assignment: Hybrid


The annual base salary for this position ranges from €31.125,00. This salary range applies to the location Greece-Thessaloniki Chortiatis. We also offer a range of benefits and programs to meet colleagues’ needs. Benefits vary by location and can include health care coverage, retirement savings plans, insurance benefits, an Employee Assistance Program, wellness benefits and more. Additional details about total compensation and benefits will be provided during the hiring process. Pfizer compensation structures and benefit packages are aligned based on the location of hire. Final compensation will be determined based on the successful candidate’s relevant skills, experience, and qualifications, in accordance with pay equity principles and applicable employment laws.


This role is posted in multiple locations. If you are applying for the role in an secondary job posting location where pay transparency regulations apply, your Talent Advisor will share the local pay information with you during the first interview.


Purpose
Breakthroughs that change patients' lives... At Pfizer we are a patient centric company, guided by our four values: courage, joy, equity and excellence. Our breakthrough culture lends itself to our dedication to transforming millions of lives.
Digital Transformation Strategy
One bold way we are achieving our purpose is through our company wide digital transformation strategy. We are leading the way in adopting new data, modelling and automated solutions to further digitize and accelerate drug discovery and development with the aim of enhancing health outcomes and the patient experience.
Flexibility
We aim to create a trusting, flexible workplace culture which encourages employees to achieve work life harmony, attracts talent and enables everyone to be their best working self. Let’s start the conversation!
Equal Employment Opportunity
We believe that a diverse and inclusive workforce is crucial to building a successful business. As an employer, Pfizer is committed to celebrating this, in all its forms – allowing for us to be as diverse as the patients and communities we serve. Together, we continue to build a culture that encourages, supports and empowers our employees.
Disability Inclusion
Our mission is unleashing the power of all our people and we are proud to be a disability inclusive employer, ensuring equal employment opportunities for all candidates. We encourage you to put your best self forward with the knowledge and trust that we will make any reasonable adjustments to support your application and future career. Your journey with Pfizer starts here!

Pfizer endeavors to make www.pfizer.com/careers accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process and/or interviewing, please email disabilityrecruitment@pfizer.com. This is to be used solely for accommodation requests with respect to the accessibility of our website, online application process and/or interviewing. Requests for any other reason will not be returned.


To learn more about acceptable and prohibited uses of AI during the recruitment process, please review our candidate AI-use guidelines available on Pfizer Careers.
Information & Business Tech
