Description
Evernorth Customer Data Platform Engineering team is looking for a Software Engineering Advisor highly skilled in Data Engineering with hands-on experience working with Snowflake.
In this role, you will provide hands-on software engineering and system architecture leadership for our CDP teams. You will be working on several of the largest Technology initiatives for Evernorth targeted at revolutionizing Health Services and Healthcare Delivery system in the United States.
Responsibilities
- Design, develop, and optimize data pipelines using Snowflake, including building and maintaining multi-layered data models.
- Extensive experience working with AWS or other cloud platforms to design, deploy, and manage scalable data solutions.
- Lead the design and development of Big Data solutions using Apache Spark (Python/Scala), enabling the processing of petabytes of data in both real-time and batch modes.
- Develop and manage end-to-end ETL/ELT pipelines using Apache Airflow, Apache NiFi, DBT, or other equivalent orchestration tools.
- Design and implement scalable and efficient data models for data storage and retrieval, ensuring data accessibility and optimization.
- Work with Kafka or other streaming technologies to enable real-time data ingestion and processing.
- Collaborate with cross-functional teams, including product, engineering, to develop and implement data solutions.
- Write complex SQL queries to transform and process data across relational and columnar databases.
- Continuously seek ways to improve the performance, scalability, and reliability of the data platform.
Qualifications
- 10+ years of experience in Data Engineering, with a proven track record of designing and building data pipelines and architectures at scale.
- At least 4 years of hands-on experience with Snowflake, including data modeling and query optimization, designing and implementing multi-layered data architectures.
- Experience with cloud services, preferably AWS (e.g., S3, EMR, EC2, Redshift, Athena, Lambda, Glue), for designing, deploying, and managing scalable data solutions.
- Strong experience in Big Data technologies like Spark (Python/Scala) for large-scale data processing.
- Proficiency in Data Orchestration and Integration tools, such as Apache Airflow, Apache NiFi, DBT, or equivalent.