Systems Test Engineer, End-to-End Validation
San Francisco, United States · Hybrid · Full-time
- Posted 1mo ago
- From OpenAI’s careers page
- Location
- San Francisco, United States
- Work mode
- Hybrid
- Type
- Full-time
- Department
- Engineering
Opens the listing on jobs.ashbyhq.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
About the Role
As a Systems Test Engineer, End-to-End Validation, you will design and execute end-to-end testing for complex device experiences spanning hardware, software, connectivity, cloud services, and accessories. You’ll translate product behavior and real-world use cases into structured, reproducible test procedures and build test environments that allow failures to be reliably reproduced and diagnosed.
You’ll also identify opportunities to automate repetitive or high-value scenarios, working with engineers to turn complex manual workflows into scalable validation systems. Because this is a new category of devices, you’ll have the opportunity to build the end-to-end validation foundation early—shaping test coverage, environments, and workflows from prototype through launch.
We’re looking for someone who combines strong systems thinking, hands-on testing skills, technical curiosity, and a rigorous approach to reproducing and diagnosing failures across multiple components.
In this role, you will:
-
Design end-to-end test coverage: Develop structured test plans and reproducible procedures for user journeys, realistic usage patterns, edge cases, degraded conditions, and failure scenarios across devices, services, connectivity, and accessories.
-
Build and operate complex test environments: Maintain setups involving devices, servers, networks, accounts, peripherals, accessories, and controlled environmental conditions; prepare devices and environments for release validation, execute test campaigns, track results, and communicate risks and blocking issues.
-
Reproduce failures and diagnose systems: Reproduce complex failures, isolate contributing components, collect logs and telemetry, and provide engineers with clear reproduction steps and supporting evidence.
-
Automate high-value scenarios: Identify repeatable manual workflows that benefit from automation and develop or partner on tooling for device control, setup, measurement, data collection, and test execution.
-
Strengthen regression coverage: Convert field issues, production failures, and previously discovered bugs into repeatable regression tests and maintain coverage across product releases.
-
Partner across teams: Work with embedded, systems, cloud, hardware, QA, and product teams to understand system behavior, improve testability, and close gaps in validation coverage.
Minimum Qualifications
-
Experience with system-level, integration, end-to-end, or validation testing for complex hardware-software products.
-
Skill in translating loosely defined product behavior into clear, repeatable, and measurable test procedures.
-
Experience testing systems that span devices, networks, backend services, mobile applications, or connected accessories.
You might thrive in this role if you:
-
Enjoy hands-on debugging and can methodically isolate failures across hardware, firmware, software, connectivity, and cloud services.
-
Are comfortable working with logs, diagnostics, command-line tools, network tools, and device configuration utilities.
-
Have experience automating tests or test setups using Python or similar scripting tools, while recognizing when manual testing provides better coverage.
-
Understand how to create reliable test environments with controlled setup, configuration, preconditions, expected results, and recovery procedures.
-
Are comfortable working across engineering disciplines and communicating complex failures with clear evidence and reproducible steps.
Skills they ask for
Pick one to see other roles that ask for it.
About OpenAI
AI research and deploymentOpenAI conducts AI research and develops products and platforms for consumers, developers and businesses.
See all 322 roles at OpenAIMore roles at OpenAI
See all 322- Market Research Lead, ChatGPTSan Francisco · Lead · HybridMarketing · Lead · HybridSan Francisco, United States8h
- Product Builder, SalesSan Francisco · HybridBusiness Operations · HybridSan Francisco, United States14h
- Account Director, CyberSan Francisco · HybridSales · HybridSan Francisco, United States23h
- Technical Accounting Lead, Ads RevenueSan Francisco · Lead · HybridFinance and Accounting · Lead · HybridSan Francisco, United States1d
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.