AI Test Engineer

Everforth ECS is seeking an AI Testing Engineer to work minimum of 3 business

days onsite at our Fairfax, VA corporate office and/or our Ashburn, VA customer

site.

Please Note: This position is contingent upon contract award.

The Artificial Intelligence (AI) Test Engineer will be part of a team of experts

charged with providing support in the areas of model analysis and model

development capabilities in response to Custom and Border Protection’s (CBP)

Project Outrider. Program scope includes model analyses and assessments to

identify mission and operational impacts and make appropriate performance

enhancement recommendations. You will be responsible for:

* The development and execution of test plans for AI models and applications,

identifying, documenting, and analyzing defects, inconsistencies, and

anomalies in AI outputs.

* Collaboration with development teams to improve AI model performance and

ensure quality standards.

* Implementing automation frameworks for AI evaluation, including dataset

checks, API testing, and CI/CD integration.

* Defining AI quality metrics and KPIs such as accuracy, latency, cost, and

fairness.

Salary Range: 125,000-150,000

General Description of Benefits [https://ecstech.com/careers/benefits]

Qualifications

• * U.S. Citizenship; Must be able to obtain and maintain a Public Trust
• determination.
• * Bachelor’s degree in Computer Science, Electrical Engineering, or a related
• technical field.
• * 2-4+ years of AI Test and Validation experience.
• * Experience working on custom development software projects.
• * Strong collaboration with cross-functional teams to identify testing
• requirements and optimize test coverage.
• * Experience with system testing metrics, best practices, and methodologies.
• * Utilization of Python and Selenium for automated testing of machine learning
• models.
• * Experience working with software development teams.
• * Experience analyzing test results and providing actionable insights to
• improve model accuracy.
• * Experience designing and implementing comprehensive test strategies for
• AI-driven applications.
• * Experience participating in requirements and design reviews, developing test
• plans, writing and executing test cases in a fast-paced software development
• environment.
• * Experience conducting data analysis, data verification and problem-solving.
• * Experience with statistical reporting and analysis.
• * Competency in developing and executing test plans for various AI
• applications, ensuring compliance with industry standards.
• * Expertise in one or more scripting languages (e.g., Unix/Linux, PERL, Java
• script) and relational database technologies (SQL, schema design).
• * Ability to work as a member of a self-organizing team without daily direct
• supervision.
• * Ability to communicate effectively within a large, dynamic team environment.
• * Ability to support three days in-office.
• * Willingness to try new things and grow.