
Agile Defense
--
--
Artificial Intelligence Subject Matter Expert (CBP)
Ashburn, VA, US
Posted on Aug 18, 2026
Job Description
The Role
What Success Looks Like
- Model performance gets validated against real operational conditions, not only against a clean benchmark dataset.
- Where a model is wrong, you can say how it is wrong and how often, rather than reporting a single accuracy number and stopping there.
- You can explain a model's behavior to someone who did not build it, in terms they can evaluate.
- Model behavior gets monitored after deployment, not just validated once before it.
- Drift and degraded performance get caught before they change an operational outcome.
- Failure modes are documented and understood before a model goes live, not discovered afterward.
- Documentation and evidence for a security or accreditation review come out of your normal development process.
- You can tell an engineering team early what an AI capability will need to clear review, before they have built around an assumption that will not survive it.
- Reviewers get a straight answer about what a model does and does not do.
- Other engineers and program staff come to you before committing to an AI approach, not after it has already been built.
- Where AI is not the right tool for a problem, you can say so and be heard.
- Standards for evaluating and deploying models exist and get used on the next project, not reinvented each time.
What You Bring
- You have taken a machine learning model from prototype to a production system that real people depended on.
- You have worked in a regulated or federal environment where a model's decisions had to be explainable and defensible, not only accurate.
- You have caught a model failure before it reached a decision that mattered, and can describe how.
- You are comfortable across the model lifecycle: data, training, validation, deployment, and monitoring, rather than specialized in only one stage.
- You hold an active CBP BI, a fitness determination at another DHS component, or an active DoD clearance. Any of these shortens your start date.
- You can talk about the limits of a model as clearly as you talk about its capabilities.
A note on timing
Employee Benefits
About Agile Defense
"Listen. Think. Innovate."
Our goal is to innovate alongside our customers to transform their operations using IT.
We support significant agency programs and work to partner with our customers to deliver quality and innovative IT solutions with our “Listen. Think. Innovate.” philosophy. Our customers include the US Department of Defense and US civil agencies, including Department of State and the Department of Interior.
Let us know how we can bring our innovation approaches and...
Job overview
Employment type
Regular
Experience level
Mid Level
Work type
Hybrid
Department
Digital Transformation
Posted
on Aug 18, 2026
Financials
Type
private
Annual Revenue
--
Market Cap
--
Amount Raised
--
Membership
Join Refer Me Membership to get referred to this role at Agile Defense.