We have a near-term need for a Testing and Evaluation Artificial Intelligence SME to provide hybrid support for DHS customers located in Washington, DC.
Responsibilities
The T&E Analyst will review and comment on revisions of program T&E documents and provide the Government advice. Support multiple DHS acquisition programs, especially in capabilities that involve AI. Provide AI T&E expertise to assist the Government with ensuring that DHS acquisition programs generate suitable, executable T&E approaches that adequately assess the effectiveness, suitability, reliability, robustness, security, explainability, and operational risks of AI technologies embedded in technical solutions. Provide support, guidance, recommendations, and mentoring to all Deputy Directors regarding AI T&E and the development of DHS standards for evaluating embedded AI technologies, including reviews of program TEMPs, Operational Assessment/Test Plans, Operational Assessment/Test Reports, and Letters of Assessment. Provide support to the instructional advisor regarding the inclusion of AI T&E within the T&E curriculum. Provide, as directed, focused training on AI T&E. Research Government and industry acquisition and T&E sources and analyze results for applicable AI evaluation standards, tools, metrics, plans, and procedures.
Qualifications
Required
Advanced Degree or equivalent credits/certifications.
10+ years of relevant experience.
Active Secret clearance .
Demonstrated skills and abilities to develop and implement strategies, standards, and methods to integrate AI T&E activities—including, but not limited to, data quality and representativeness assessments, AI performance and robustness testing, bias assessments, human-AI interaction evaluations, adversarial testing, and post-deployment monitoring—in support of acquisition programs, including, but not limited to, aviation, detection equipment, cybersecurity, information technology, decision-support systems, and autonomous systems.
Desired
DHS T&E Level 3 equivalent certification.
Pay Range Information
At SPA, we strive to deliver a robust total compensation package that will attract and retain top talent. Elements of the compensation package include competitive base pay and variable compensation opportunities. SPA provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health insurance, flexible spending accounts, health savings accounts, retirement savings plans, life and disability insurance programs, and a number of programs that provide for both paid and unpaid time away from work. The specific programs and options available to any given employee may vary depending on eligibility factors such as geographic location, date of hire, etc. Please note that the salary information shown below is a general guideline only. Salaries are commensurate with experience and qualifications, as well as market and business considerations. Washington, DC, Pay Transparency Salary range: USD $170,000.00/Yr. - USD $200,000.00/Yr.
The T&E Analyst will review and comment on revisions of program T&E documents and provide the Government advice. Support multiple DHS acquisition programs, especially in capabilities that involve AI. Provide AI T&E expertise to assist the Government with ensuring that DHS acquisition programs generate suitable, executable T&E approaches that adequately assess the effectiveness, suitability, reliability, robustness, security, explainability, and operational risks of AI technologies embedded in technical solutions. Provide support, guidance, recommendations, and mentoring to all Deputy Directors regarding AI T&E and the development of DHS standards for evaluating embedded AI technologies, including reviews of program TEMPs, Operational Assessment/Test Plans, Operational Assessment/Test Reports, and Letters of Assessment. Provide support to the instructional advisor regarding the inclusion of AI T&E within the T&E curriculum. Provide, as directed, focused training on AI T&E. Research Government and industry acquisition and T&E sources and analyze results for applicable AI evaluation standards, tools, metrics, plans, and procedures.
Required
Advanced Degree or equivalent credits/certifications.
10+ years of relevant experience.
Active Secret clearance .
Demonstrated skills and abilities to develop and implement strategies, standards, and methods to integrate AI T&E activities—including, but not limited to, data quality and representativeness assessments, AI performance and robustness testing, bias assessments, human-AI interaction evaluations, adversarial testing, and post-deployment monitoring—in support of acquisition programs, including, but not limited to, aviation, detection equipment, cybersecurity, information technology, decision-support systems, and autonomous systems.
Desired
DHS T&E Level 3 equivalent certification.