Description
We are seeking experienced Data Engineers who are passionate about combining data with emerging technologies to drive business growth. As a Data Engineer 4 at Capital One, you will lead the design, development, testing, implementation, and support of technical solutions using full-stack development tools and technologies.
Key Responsibilities:
- Collaborate with cross-functional Agile teams to develop and implement technical solutions
- Influence a team of developers, data analysts, and data scientists with expertise in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Utilize programming languages such as Python and Spark, along with open-source relational and NoSQL databases, and cloud-based data warehousing platforms like Databricks and Snowflake
- Stay up-to-date with industry trends, experiment with new technologies, and mentor other data community members
- Design, build, and deliver cloud-first data solutions that drive customer experiences and financial empowerment
- Independently design, build, and deliver world-class cloud data solutions and applications
- Architect and enforce common data engineering design patterns to ensure code quality, maintainability, and reusability
- Serve as an ambassador for the data engineering team, communicating technical concepts and data outcomes to stakeholders
- Design and build scalable, resilient, and efficient data pipelines and platforms
- Implement data security standards, including encryption and access control, to ensure compliance with regulations
Requirements:
- Bachelor's degree or higher in Computer Science or a related quantitative field
- At least 4 years of experience in application development
- At least 2 years of experience in distributed data, SQL, and one programming language (Python, Java, or Scala)
- At least 2 years of experience in data pipeline design and development
- At least 1 year of experience in data modeling and designing end-to-end data solutions
Preferred Qualifications:
- 7+ years of experience in application development with proficiency in Python, SQL, Scala, or Java
- 4+ years of hands-on experience designing, deploying, and operating data workloads in public cloud environments
- 4+ years of experience building or supporting distributed data or compute workloads using tools like EMR, Spark, Glue, or Databricks
- 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- 2+ years of experience working on data observability or data orchestration tools
- 4+ years of experience working with unstructured or semi-structured data using NoSQL databases
- 4+ years of experience designing and supporting data warehousing solutions
- 2+ years of experience working in an Agile development environment
- 2+ years of experience developing user-centric reusable data products
Salary: $197,300 - $225,100 per year
Benefits: Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.