Staff Engineer, AI Operations & Governance, Workplace AI
United States · Remote · Full-time
- Posted 2w ago
- From Shield AI’s careers page
- Location
- United States
- Work mode
- Remote
- Type
- Full-time
- Level
- Senior
- Experience
- 4+ years
- Department
- Information Technology
Opens the listing on jobs.lever.co
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
Key responsibilities:
-
Implement and maintain AI platform configurations Own day-to-day configuration of AI platforms and orchestration tools (models, routes, guardrails, tenants, policies, role mappings, prompt libraries, etc.), under the direction of the Head.
-
Manage connectors, integrations, and data access paths Design, configure, and maintain connectors and extensions into SaaS systems, data sources, and workflow tools; ensure connectivity is reliable, secure, and aligned with access policies.
-
Own observability wiring for AI tools Set up and maintain logging, metrics, and alerts for AI workflows and tools; make sure key signals (latency, errors, usage, drift indicators) are captured and visible to the team.
-
Handle secrets and access hygiene Implement secure storage and rotation for API keys, tokens, and credentials; maintain access control configurations and partner with Security/IT on reviews and remediation.
-
Execute model and configuration changes in production Implement model swaps, policy updates, prompt changes, version upgrades, and rollout plans based on decisions made by the Head; maintain detailed change records and rollback paths.
-
Support technical evaluations and benchmarking Run experiments and benchmarks on models, tools, and configurations; collect and summarize technical performance data to inform governance and roadmap decisions.
-
Translate technical signals into governance and risk views Help the Head interpret logs, metrics, and incidents into clear risk, reliability, and compliance narratives that can be shared with Security, Legal, HR, and business sponsors.
-
Contribute to playbooks and training Co-author technical sections of operational playbooks, runbooks, and training materials; occasionally participate in training or office hours to help users understand capabilities and guardrails.
-
Coordinate and communicate on incidents and changes Act as a technical point of contact in incidents: triage, investigate, propose mitigations, execute fixes, and document learnings; communicate clearly with non-technical stakeholders when needed.
Required qualifications:
- 4–7+ years in roles such as platform engineer, DevOps/SRE, ML/AI operations, or technical SaaS operations, with hands-on responsibility for production systems.
- Strong fluency in APIs, integrations, and infrastructure-as-config concepts; able to work in code/JSON/YAML configuration environments and with automation where appropriate.
- Hands-on experience with monitoring and observability tools (logs, metrics, alerts) and using them to diagnose issues and guide improvements.
- Practical experience working with at least one class of AI or automation platforms (LLM providers, AI productivity tools, RPA/workflow engines, or similar).
- Comfort with secure secrets management and access control practices (roles, permissions, key rotation, least-privilege patterns).
- Ability to document technical work and decisions clearly for both technical and non-technical audiences.
- Strong ownership mindset, bias to action, and comfort operating close to production in a high-stakes environment.
Preferred qualifications:
- Experience in ML/AI ops specifically (model deployment, evaluation, drift monitoring), even if not as a dedicated ML engineer.
- Familiarity with prompt engineering, policies/guardrails, and configuration patterns for LLM-based systems.
- Exposure to governance, compliance, or risk frameworks for data-driven or AI systems.
- Experience collaborating with Security, Legal, and business stakeholders on technical risk and mitigation.
- Prior involvement in incident response, change management, or on-call rotations for critical systems.
Skills they ask for
Pick one to see other roles that ask for it.
About Shield AI
AI systems for defense and autonomous aircraftShield AI develops AI-enabled aircraft and autonomous systems, including Hivemind, to support service members and civilians.
See all 278 roles at Shield AIMore roles at Shield AI
See all 278- Engineer II, Mission Systems (R6241)Dallas · On-siteEngineering · On-siteDallas, United States2h
- Senior Staff Engineer, Structures and Vibration (6237)Dallas · Staff · On-siteEngineering · Staff · On-siteDallas, United States2h
- Engineer I, Software - Factory Team (R6235)Washington · Entry Level · On-siteSoftware Development · Entry Level · On-siteWashington, United States2h
- Staff Engineer, Supply Chain (R6228)Dallas · Staff · On-siteSupply Chain / Logistics / Procurement · Staff · On-siteDallas, United States2h
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.