Description
We’re Workday, a Fortune 500 company and a leading AI platform for managing people, money, and agents. We're looking for a Software Development Engineer to join our Data Platform and Observability Engineering (DPOE) team.
The DPOE team is building Workday’s next-generation, multi-petabyte-scale Observability Platform. You will build and scale core features of Workday’s distributed tracing platform, working with ClickHouse, Grafana Tempo, and a modern big-data pipeline (Kafka, Spark/Flink, Iceberg, S3) on AWS.
Responsibilities
- Develop the Platform: Write high-quality, well-tested code to build and scale features for the distributed tracing platform on ClickHouse/Tempo, focusing on robust ingestion and fast query execution.
- Maintain Big-Data Pipelines: Build and support high-throughput data pipelines using Kafka, Spark/Flink, and Iceberg-on-S3.
- Tune and Optimize: Write optimized code and participate in profiling and resolving latency or throughput issues in production environments.
- Ensure Reliability: Implement robust error handling, retries, and failover mechanisms to ensure high availability for tracing services.
- Secure the Data: Apply necessary security controls to ensure multi-tenant data access is properly handled according to platform architecture.
- Operational Support: Maintain the health of the platform through comprehensive monitoring, logging, and alerting, and participate in the team’s on-call rotation.
- Support Observability AI: Build reliable data ingestion paths that will serve as the foundation for AI-driven anomaly detection and root-cause analysis.
- Collaborate and Learn: Write clear technical documentation, participate actively in system design reviews, and work closely with Senior and Principal engineers to level up your distributed systems knowledge.
Requirements
- 5+ years experience in software development engineering.
- 3+ years experience specifically focused on designing, building, and operating complex distributed system architectures.
- 5+ years experience with at least two of the following programming languages: Java, Python, Go.
- Bachelor’s degree in a relevant field such as Computer Science, Engineering, or a related discipline; a Master's degree (e.g., MS in Computer Science, Distributed Systems, or related field) is strongly preferred or equivalent practical experience.
Nice to Have
- Strong ability in Algorithmic to build highly efficient and scalable solutions for complex high-throughput data ingestion and sub-second query performance challenges.
- Solid experience in API Development, including an understanding of gRPC, REST, and OpenTelemetry (OTLP).
- Strong understanding of Code Testing methodologies, such as distributed load testing and integration testing.
- Solid understanding of Distributed Systems Software principles, including data partitioning, eventual consistency, and fault tolerance mechanisms.
- Experience implementing and maintaining High Availability strategies for critical distributed systems.
Pay and Benefits
- The annualized base salary ranges for the primary location are $148,000 USD - $222,000 USD.
- As a part of the total compensation package, this role may be eligible for the Workday Bonus Plan or a role-specific commission/bonus, as well as annual refresh stock grants.