Description
We are seeking experienced Data Engineers to join our team at Capital One. As a Data Engineer 5, you will collaborate with cross-functional teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies.
Responsibilities:
- Collaborate with Agile teams to develop and implement technical solutions
- Influence a team of developers, data analysts, and data scientists with expertise in machine learning, distributed microservices, and full-stack systems
- Utilize programming languages such as Python and Spark, along with open-source relational and NoSQL databases, and cloud-based data warehousing platforms including Databricks and Snowflake
- Stay up-to-date with trends in data and emerging technologies, and share knowledge with the data community
- Collaborate with product managers and software engineers to deliver robust cloud-first data solutions
- Independently design, build, and deliver world-class cloud data solutions and applications
- Architect and enforce common data engineering design patterns to ensure code quality, maintainability, and reusability
- Serve as an ambassador for the data engineering team, communicating technical concepts and data outcomes to internal and external stakeholders
- Design and build data pipelines and platforms with a focus on scalability, resilience, and operational efficiency
- Lead and execute large-scale, transformative data initiatives from end to end
Basic Qualifications:
- Bachelor's Degree or higher in Computer Science or a related quantitative field
- At least 6 years of experience in application development
- At least 4 years of experience in distributed data
- At least 4 years of experience with SQL
- At least 4 years of experience programming with at least one of the following languages: Python, Java, or Scala
- At least 4 years of experience designing and developing data pipelines
- At least 2 years of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems
Preferred Qualifications:
- Master's Degree in Computer Science or a related field
- 8+ years of experience in data engineering
- 4+ years of data modeling experience
- 9+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
- 5+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment
- 5+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 5+ years of experience designing, implementing, and operating real-time or streaming data pipelines
- 3+ years of experience working on data observability or data orchestration tools
- 5+ years of experience working with unstructured or semi-structured data using NoSQL databases
- 5+ years of experience designing and supporting data warehousing solutions
- 3+ years of experience working in an Agile development environment
- 3+ years of experience developing user-centric reusable data products
Salary Information: The minimum and maximum full-time annual salaries for this role are listed below, by location: Chicago, IL: $209,000 - $238,500 McLean, VA: $229,900 - $262,400 New York, NY: $250,800 - $286,200 Richmond, VA: $209,000 - $238,500
Benefits: Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.