Description
As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud.
Our developers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, JSON, and SQL to build products, tools, and features that power customer personalization at scale.
Responsibilities:
- Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC.
- Develop business domain understanding and bridge this to technical stakeholders.
- Set technical strategy in partnership with Data Science, Product, Architecture, and Kroger partners.
- Oversee teams of Engineers including operations and development, blended Offshore/Onshore.
- Provide mentoring to junior resources.
- Lead design and development of Databricks-based solutions.
- Perform development of REST APIs hosted in Kubernetes.
- Execute unit and integration testing.
- Collaborate with senior resources to ensure consistent development practices.
- Bring new perspectives to problems and be driven to improve yourself and the way things are done.
Qualifications, Skills, and Experience:
- Bachelor’s degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program.
- 5+ years proven ability of professional data development experience.
- Strong understanding of Agile Principles (Scrum).
- 5+ years proven ability of developing with Spark (Databricks, PySpark).
- Full understanding of ETL concepts and data warehousing concepts.
- 3+ years developing experience with Python.
- 1+ year developing experience with REST APIs.
- 1+ year experience with Kubernetes.
Benefits:
- Health: Medical, dental, and vision benefits with competitive plan designs and support for self-care, wellness, and mental health.
- Wealth: 401(k) with Roth option and matching contribution, Health Savings Account with matching contribution, AD&D and supplemental insurance options.
- Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, and 6 company-paid holidays per year.