Senior Software Engineer

Slack is looking for a senior software engineer to join the Data Ingestion Team. As part of the Data Engineering organization, we build and operate the platform that ingests data from various sources into our Lakehouse with both streaming and batch approaches.

Currently, our infrastructure handles 180PB+ of storage, processes ~1T records a day, 400+ data pipelines and 1500+ Active Airflow DAGs. As Slack’s data grows, the goal of the team is to build a highly scalable and resilient ingestion platform leveraging modern Streaming and Lakehouse technologies.

As a Senior Engineer, you will play a key role in driving our streaming and lakehouse strategies while also building highly scalable services and tools to help our customers acquire large volumes of high-quality data at scale and making customers’ interactions with the ingested data pleasant and productive.

Responsibilities:

• Design and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasets
• Design and implement Slack’s Lakehouse solutions and enable production use cases for customers
• Improve the reliability and performance of the services/pipelines through AI-assisted and/or Agentic solutions and tools
• Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration)
• Collaborate with cross-functional partners and lead technical initiatives independently end-to-end
• Coach and mentor other engineers across the team and the organization
• Write, review, or provide feedback on technical design proposals

Requirements:

• U.S. citizenship and willing to undergo a background check for GovSlack authorization
• 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies
• Hands-on experience with building and maintaining batch data pipelines using Spark, Airflow, EMR, S3, or equivalent
• Proficiency in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go, or equivalent
• Skilled at crafting and building robust distributed microservices with tools like Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, etc.

Nice to Have:

• Familiarity with AI-assisted software development and automation
• Excellent written and verbal communication and interpersonal skills
• High growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them

Benefits:

• Time off programs
• Medical, dental, vision
• Mental health support
• Paid parental leave
• Life and disability insurance
• 401(k)
• Employee stock purchasing program