Staff Engineer, Test Automation (R5792)
San Diego, United States · On-site · Full-time
- Posted 1w ago
- From Shield AI’s careers page
- Location
- San Diego, United States
- Work mode
- On-site
- Type
- Full-time
- Level
- Senior
- Experience
- 8+ years
- Department
- Information Technology
Apply on Shield AI’s site
Opens the listing on jobs.lever.co
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
What you'll do:
- Own the technical strategy, architecture, and roadmap for automated testing, verification, and MLOps quality across the Hivemind ecosystem.
- Design and maintain scalable test frameworks for autonomy software, backend services, APIs, operator-facing applications, and distributed hardware environments.
- Lead functional, integration, regression, system, performance, reliability, and end-to-end testing across simulation, edge-compute, software-in-the-loop, and hardware-in-the-loop environments.
- Build automated ML validation pipelines covering data quality, training reproducibility, model accuracy, robustness, regression, latency, resource utilization, and system integration.
- Establish CI/CD and continuous training workflows that provide versioning and traceability for datasets, models, configurations, evaluation results, and deployment artifacts.
- Develop scenario-based validation for autonomy models, including edge cases, degraded sensing or communications, distribution shifts, and representative mission conditions.
- Create observability, analytics, and failure-triage capabilities for software behavior, model and data drift, inference health, test results, and production performance.
- Build Python automation that improves test execution, parallelization, reporting, environment setup, experiment comparison, and developer productivity.
- Create test harnesses, simulators, stubs, mocks, and synthetic data capabilities that improve system testability and coverage.
- Collaborate with software, autonomy, machine learning, data, simulation, and systems engineers to define verification strategies and improve designs before implementation.
- Develop and govern AI-assisted engineering workflows using coding agents and LLM-based tools for test generation, log analysis, debugging, and failure triage while maintaining security, reproducibility, and traceability.
Skills they ask for
Pick one to see other roles that ask for it.
About Shield AI
AI systems for defense and autonomous aircraftShield AI develops AI-enabled aircraft and autonomous systems, including Hivemind, to support service members and civilians.
See all 268 roles at Shield AIMore roles at Shield AI
See all 268- Engineer I, Software Integration (R6214)Washington · Entry Level · On-siteSoftware Development · Entry Level · On-siteWashington, United States4h
- Senior Staff Engineer, Supply Chain (R6213)Seattle · Staff · On-siteSupply Chain / Logistics / Procurement · Staff · On-siteSeattle, United States5h
- Senior Environmental Test Technician (R6211)Seattle · Senior · On-siteEngineering · Senior · On-siteSeattle, United States5h
- Senior Principal Engineer, GNC & State Estimation (R6233)San Diego · Principal · On-siteEngineering · Principal · On-siteSan Diego, United States5h
Share this role
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.