Senior Software Engineer, AI Tooling
Austin, United States · Hybrid · Full-time
- Posted 3w ago
- From Roku’s careers page
- Location
- Austin, United States
- Work mode
- Hybrid
- Type
- Full-time
- Level
- Senior
- Experience
- 2+ years
- Department
- Software Development
Apply on Roku’s site
Opens the listing on weareroku.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
What you'll be doing
- Responsible for designing and implementing secure, reliable AI-powered tools and platforms—using technologies such as large language models and retrieval-augmented generation—and integrating them into core engineering workflows to improve quality, performance, and operational oversight.
- AI Leadership: Architect and guide implementation of AI tooling and pipelines using LLMs, RAG, and MCP, including retrieval design, model orchestration, safety guardrails, and backend integrations. Establish standards for data validation, analysis, and anomaly detection; implement automated quality gates to safeguard log and telemetry integrity at scale. Define coding and documentation standards for Python-based services and AI-assisted development; conduct code and design reviews to uphold engineering rigor. Develop performance testing and monitoring strategies; instrument metrics and health endpoints to drive continuous optimization.
- Technical Delivery: Create and maintain software solutions within the team’s domain; own epics and tasks and delegate work as needed to ensure timely delivery.
- Mentoring and Coaching: Lead onboarding and accelerate ramp-up through structured curricula, shadowing, and clear success metrics. Provide educational code/design reviews and formal training; serve as a Subject Matter Expert to unblock teams, elevate standards, and develop future senior engineers.
- People Collaboration: Orchestrate cross-functional alignment with system architects, platform, UI, product, data, and QA to deliver core OS features and high-impact platform improvements on schedule. Lead incident triage and root-cause analysis across logging, telemetry, and developer tooling, including AI-assisted workflows with RAG insights and MCP integrations; optimize pipelines for reliability, latency, and cost.
- Business Leadership: Translate company strategy into an engineering roadmap with clear priorities, success metrics, and delivery commitments; make disciplined trade-offs to maximize customer impact, reliability, and cost efficiency. Align stakeholders on objectives and risks; communicate rationale and expected outcomes; adjust plans based on data and changing business needs.
You are required to have
- Bachelor’s degree or foreign equivalent in Computer Science or related field.
- 2 years experience in position, as a Software Engineer, or related occupation.
Must have at least 1 year of prior work experience in each of the following:
- Build and integrate AI tooling using Agents, Model Context Protocol (or equivalents) with adapters, authentication, auditing, and lifecycle management.
- Develop and evaluate prompts and systems with grounding, citation, hallucination mitigation, red-teaming, and A/B experimentation.
- Design and deliver user interfaces that prioritize clarity, discoverability, minimal friction, and consistent interaction patterns across surfaces.
- Optimize performance through latency/throughput tuning, async/concurrency patterns, profiling, and device–cloud considerations.
- System design, tradeoff analysis, architectural patterns, and code reviews.
- Python services, Linux, cloud-native stacks, concurrency/async I/O, and modern networking for AI workloads.
Skills they ask for
Pick one to see other roles that ask for it.
About Roku
The streaming platform for televisionRoku operates a TV streaming platform spanning streaming players, Roku TV, its operating system, content channels and advertising tools.
See all 51 roles at RokuMore roles at Roku
See all 51- Senior Software Engineer, Advanced DevelopmentAustin · Senior · HybridSoftware Development · Senior · HybridAustin, United States8h
- Account Executive, Media and EntertainmentNew York · HybridSales · HybridNew York, United States1d
- Senior Product Manager, Advertising – Supply IntegrationsNew York · Senior · HybridProduct Management · Senior · HybridNew York, United States2d
- Assistant General Counsel, Legal & Business Affairs - Ad Tech & Media TransactionsNew York · Senior · HybridLegal and Compliance · Senior · HybridNew York, United States2d
Share this role
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.