Description
We are looking for a Senior Software Engineer to join our Lakeflow Connect team. As a key member of the team, you will be responsible for designing and developing highly scalable, available, and fault-tolerant engines that process hundreds of TB of data daily across thousands of customers.
Your primary focus will be on extracting data from OLTP systems while imposing minimal load on production systems. You will work closely with other products to embed Connect into various surfaces in Databricks, including Dashboards, Notebooks, SQL, and AI.
To succeed in this role, you unix operating system, Python, Java, Scala, C++, or similar language. You should have experience developing large-scale distributed systems from scratch and be familiar with areas like Database replication, backup, transaction recovery at one of the major database vendors (Microsoft SQL Server, Oracle, IBM etc).
In addition to your technical skills, you should be able to contribute effectively throughout all project phases, from initial design and development to implementation and ongoing operations, with guidance from senior team members.