Staff Software Engineer – Extreme Platform ONE (10548)

Key Responsibilities

• Design and build real-time data ingestion pipelines using Kafka and Numaflow to process high-volume platform telemetry and monitoring events.
• Architect enrichment pipelines that transform raw event data into contextualized, actionable performance signals.
• Own the persistent storage strategy across ClickHouse, TimescaleDB, and Elasticsearch, matching each data store to the right access pattern, and optimize queries, indexing, and partitioning to meet latency and throughput targets at scale.
• Design data retention, rollup, and partitioning strategies that balance query performance with storage cost.
• Tune the EP1 performance monitoring platform to handle growing data volume and query concurrency.
• Identify and resolve bottlenecks across the full pipeline, from Kafka consumer lag to storage-layer query plans.
• Design for horizontal scalability, including partitioning, sharding, and load distribution across data stores.
• Establish capacity planning and load-testing practices for the platform's data infrastructure.

Build, Deployment & Collaboration

• Support pre-deployment verification, including performance regression testing and security checks.
• Collaborate with QA to validate data pipeline correctness and system resilience under load.
• Apply secure coding practices and participate in code reviews with a security lens.
• Maintain documentation of system architecture, data flows, and operational runbooks.
• Partner with engineering, data, and platform teams on design reviews and technical decisions.