Senior Data Platform Engineer
San Francisco, United States · Remote
- Posted 5d ago
- From Komodo Health’s careers page
- Location
- San Francisco, United States
- Work mode
- Remote
- Level
- Senior
- Department
- Engineering
Opens the listing on job-boards.greenhouse.io
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
We Breathe Life Into Data
At Komodo Health, our mission is to reduce the global burden of disease. We believe smarter use of data is essential to this mission. That's why we built the Healthcare Map, the industry's largest, most complete, precise view of the U.S. healthcare system, by combining de-identified, real-world patient data with innovative algorithms and decades of clinical experience. The Healthcare Map serves as our foundation for a powerful suite of software applications, helping us answer healthcare's most complex questions for our partners.
As we pursue these goals, we stay grounded in our values: be awesome, seek growth, deliver "wow," and enjoy the ride.
The Opportunity at Komodo Health:
Join Komodo Health's Data Foundations team and play a critical role in shaping the core data products that fuel our Healthcare Map. You'll transform massive, complex healthcare datasets into performant, trustworthy data assets that power customer-facing products, internal innovation, and AI/ML use cases.
Mission:
The Senior Data Platform Engineer will design, build, operate, and improve the large-scale pipelines and foundational data platform behind Komodo's Healthcare Map. This is a hands-on engineering role focused on processing complex healthcare data at scale, improving reliability and performance, and contributing to the technical direction of core data systems.
Looking back on your first 12 months at Komodo Health, you will have:
- Architectural Advancement: Delivered high-impact technical initiatives that improve pipeline performance, scalability, and system efficiency.
- Platform Hardening: Improved the reliability, observability, and cost-efficiency of core Data Foundations systems.
- Healthcare Data Innovation: Built deep domain expertise and contributed new approaches to challenges such as patient journey mapping and identity resolution.
- Cross-Functional Delivery: Partnered with Data Product and Engineering teams to ship scalable, production-grade data solutions.
- Architecture Partnership: Raised the bar across the team through mentorship, design reviews, and engineering best practices.
Key Responsibilities:
- Build, operate, and optimize large-scale batch pipelines using Python, SQL, Spark, and Airflow on AWS
- Make storage and data layout decisions (table formats, partitioning, file sizing, compaction) that keep large datasets fast to query and cost-efficient
- Ingest data from many external sources and keep pipelines correct through frequent schema changes
- Transform healthcare claims, EHR, and reference data into trusted, serving-ready data products for customers and internal teams
- Strengthen reliability through data quality checks, validation, lineage, observability, and alerting
- Debug complex data, system, and performance issues across compute-heavy workflows
- Contribute to system design, code quality, testing, documentation, CI/CD, and rotational production support
What you bring to Komodo Health:
- Strong hands-on experience building, owning, and debugging production data pipelines at multi-terabyte scale
- Advanced Python, including performant, memory-efficient code for large-scale data processing, plus strong SQL
- Deep production experience with Airflow, including operating and scaling it, not just writing DAGs
- A solid understanding of how data is physically stored: columnar vs. row formats, and open table formats like Iceberg, Delta Lake, or Hudi (updates, compaction, small files, partitioning)
- Experience with Spark or a comparable distributed processing framework
- Proven experience designing and operating data systems in AWS
- Strong instincts for data correctness, root-cause analysis, and production troubleshooting
- The ability to communicate technical trade-offs clearly with engineering, product, and data partners
- Comfort using AI-assisted engineering tools for coding, debugging, documentation, and technical exploration
AI-Augmented Engineering Expectations:
- You will be expected to leverage AI-augmented engineering tools, such as ChatGPT, Gemini, or Claude, to improve productivity and technical decision-making. This may include using AI to generate and refine code, accelerate documentation, automate test case creation, debug complex issues, explore unfamiliar technical concepts, and assess architectural trade-offs and risks.
Additional skills and experience we'd prioritize (nice to have):
- Containers and orchestration (Docker, Kubernetes)
- Strong core software engineering fundamentals and experience in more than one language
- Data governance and lineage experience
- Experience delivering external-facing data products through APIs, serving layers, or customer access patterns
- Experience applying AI or agentic workflows to engineering, data quality, delivery, or operations
- Success in high-growth or ambiguous environments
No healthcare background required. You'll build that domain expertise here.
Open to US remote, OR SF/NYC hybrid.
Pay Range:
The pay range for each job posting reflects a minimum and maximum range of annual base pay that we reasonably expect to pay for this position within the US. The starting annual base pay for this role is $196,000 to $230,000 USD in the San Francisco Bay Area and New York City, and $170,000 to $200,000 USD in all other US locations. This position may be eligible for performance-based bonuses and equity awards. Benefits include comprehensive health, dental, and vision insurance; flexible time off and holidays; 401(k) with company match; disability insurance and life insurance; and leaves of absence in accordance with applicable state and local laws and company policy.
Komodo's AI Standard:
At Komodo, we're not just witnessing the AI revolution, we're leading it. AI here isn't optional; it's foundational. We expect you to integrate AI into your daily work, from summarizing documents to automating workflows and uncovering insights.
Where You'll Work:
Komodo Health has a hybrid work model with hubs in San Francisco, New York City, and Chicago. Roles vary: some can be performed from anywhere in the country, others are scoped to a specific region, and some are based near one of our hubs.
Equal Opportunity Statement:
Komodo Health provides equal employment opportunities to all applicants and employees. We prohibit discrimination and harassment of any type with regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.
Skills they ask for
Pick one to see other roles that ask for it.
About Komodo Health
Healthcare data and AI for life sciencesKomodo Health provides healthcare data, analytics, and AI tools for organizations making decisions across healthcare and life sciences.
See all 16 roles at Komodo HealthMore roles at Komodo Health
See all 16- Sales Development RepresentativeNew YorkSalesNew York, United States2w
- Principal Product Manager, AI ProductsUnited States · Principal · HybridProduct Management · Principal · HybridUnited States3w
- Staff Software Engineer, Query Engine [Rust]United States · Staff · HybridEngineering · Staff · HybridUnited States3w
- Director, Customer SupportUnited States · Director · HybridCustomer Service · Director · HybridUnited States1mo
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.