Lead and independently manage evaluation projects through planning, implementation, analysis, reporting, stakeholder engagement, follow-up, and close-out.
Collect, analyze, synthesize, and interpret qualitative and quantitative data to support evidence-informed decision making.
Develop reports, presentations, recommendations, and other communication products that support decision making and continuous improvement for educational leaders, committees, program teams, and stakeholders.
Provide consultation and guidance regarding evaluation methods, assessment strategies, continuous improvement processes, and program effectiveness.
Support educational governance, accreditation, quality assurance, institutional reporting, and program-review initiatives.
Collaborate with faculty, administrators, learners, OAE colleagues, and institutional stakeholders to advance evaluation and improvement priorities.
Maintain documentation, project records, data stewardship practices, and follow-up processes that support accountable and appropriate use of evaluation findings.
Contribute to departmental initiatives and perform other duties as assigned.
Minimum Qualifications
Master’s Degree in Program Evaluation, Educational Research, Public Health, health Professions Education, Social Sciences, Higher Education, Organizational Development, Improvement Science, or a related field.
Five years of progressively responsible experience in program evaluation, assessment, institutional research, continuous quality improvement, accreditation support, or related analytical work.
Experience supporting program evaluation, assessment, institutional research, quality improvement, accreditation, or related initiatives.
Additional education may substitute for required experience, and additional related experience may substitute for required education beyond a high school diploma/graduation equivalent, to the extent permitted by the JHU equivalency formula.
Preferred Qualifications
Doctoral Degree in Educational Psychology, Program Evaluation, Health Professions Education, Educational Research, Public Health, Higher Education, Social Sciences, Improvement Science, or a closely related field.
Experience in medical, health professions, biomedical, or higher education.
Experience independently leading complex program evaluation or continuous-improvement initiatives.
Experience using qualitative, quantitative, or mixed-methods evaluation approaches.
Experience managing multiple projects, timelines, deliverables, and stakeholders.
Experience developing evaluation frameworks, instruments, indicators, reporting systems, or improvement workflows.
Experience communicating findings, limitations, recommendations, and implementation status to diverse audiences.
Experience supporting accreditation, governance, educational quality review, institutional reporting, or program-review activities.
Special Knowledge, Skills, and Abilities
Knowledge of program evaluation, assessment, continuous improvement, and quality assurance principles.
Knowledge of qualitative, quantitative, and mixed-methods research or evaluation methods.
Ability to analyze, synthesize, interpret, and communicate complex information clearly and accurately.
Strong project management, organization, consultation, collaboration, and follow-through skills.
Ability to work independently and collaboratively within a multidisciplinary environment while maintaining appropriate confidentiality, documentation, and data stewardship practices.
Technical qualifications or specialized certifications
Proficiency with Qualtrics and experience using artificial intelligence tools to support evaluation, data management, analysis, reporting, or workflow improvement within secure, responsible, and well-documented processes.
Proficiency with standard office, survey, data-management, project-management qualitative-analysis, data-visualization, and reporting tools appropriate to assigned evaluations.
- Classified Title: Psychometrician
- Job Posting Title (Working Title): Program Evaluation & Continuous Improvement Specialist (SOM - Assessment and Evaluation)
- Role/Level/Range: ACRP/04/ME
- Starting Salary Range: $66,215 - $116,130 Annually ($91,225 targeted; Commensurate w/exp.)
- Employee group: Full Time
- Schedule: Monday-Friday, 8.30am-5.00pm
- FLSA Status: Exempt
- Location: Hybrid/School of Medicine Campus
- Department name: SOM Admin Assessment Evaluation
- Personnel area: School of Medicine