Description
The Director, Data Engineering, leads technical strategy, people development, and cross-functional delivery for the Cloud Platform and Clean Rooms, a strategic FY27 priority and enterprise data platforms and services.
This technically engaged leader owns architectural direction, engineering excellence, and end-to-end delivery; builds high-performing teams; and aligns stakeholders on priorities, investments, and execution.
The role combines deep expertise in Apache Spark, Scala, SQL, and distributed systems with the ability to guide critical design decisions and resolve complex engineering challenges.
Key Responsibilities:
- Own technical strategy, architecture, and roadmaps for the Cloud Platform, Clean Rooms, and enterprise data services, guiding delivery from pilot through production.
- Provide hands-on technical leadership through critical design and code reviews, performance optimization, and complex production issue resolution across Spark, Scala, SQL, and distributed systems.
- Oversee high-volume batch and streaming pipelines, data modeling, orchestration, and automated data quality controls for Core Data Assets, including Authorization and Clearing & Settlement.
- Own end-to-end delivery of curated datasets, reusable data products, and secure data services across on-premises and cloud environments.
- Establish engineering standards for automated testing, CI/CD, secure development, and production readiness; drive reliability through observability, service-level objectives, incident response, and tested recovery procedures.
- Embed privacy, security, access governance, and data lifecycle controls into platform architecture and operations.
- Drive responsible adoption of AI-assisted development and agentic workflows, with human oversight and measurable productivity and quality improvements.
- Build, lead, and develop high-performing engineering teams; own hiring, workforce planning, performance management, career development, and succession planning.
- Coach technical leaders and engineers, establish clear accountability, and empower independent execution within a culture of inclusion, innovation, and engineering excellence.
- Partner with senior leadership to shape enterprise data strategy and translate business priorities into investment decisions, roadmaps, and measurable outcomes.
- Align Product, Architecture, Engineering, Operations and Infrastructure (O&I), Cybersecurity, Risk, Privacy/Legal, and Finance on priorities, dependencies, and trade-offs.
- Communicate progress, risks, and business impact to executive stakeholders; resolve competing priorities and drive adoption of shared data capabilities.
Qualifications
- 10+ years of relevant work experience with a Bachelor's Degree.
- Demonstrated people management experience, including hiring, coaching, performance management, and accountability for complex engineering delivery.
- Strong hands-on expertise in Apache Spark, Scala, SQL, and distributed data systems, including Hadoop, Hive, Kafka, and distributed storage.
- Hands-on experience with AI-assisted development tools and coding agents, including validation for correctness, performance, and security.
Benefits
- Comprehensive benefits package that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.
Salary
- Estimated salary range: $219,100.00 to $350,800.00 USD per year.
For more fresh new jobs, check out yubhub.co.