Description
We are looking for a Staff Software Engineer to join our Lakeflow Connect team. As a key member of the team, you will be responsible for designing and implementing the ingestion capabilities of the Lakehouse. You will work closely with other products to embed Connect into various surfaces in Databricks.
The successful candidate will have experience in core database internals and be able to extract data from OLTP systems while imposing minimal load on production systems. They will also be able to build systems that use techniques such as incremental data capture and log parsing.
Key responsibilities:
- Design and implement the ingestion capabilities of the Lakehouse
- Work closely with other products to embed Connect into various surfaces in Databricks
- Extract data from OLTP systems while imposing minimal load on production systems
- Build systems that use techniques such as incremental data capture and log parsing
- Collaborate with cross-functional teams to ensure seamless integration of Connect with other Databricks products
Requirements:
- 15+ years of industry experience building and supporting large-scale distributed systems
- Experience in areas like database replication, backup, and transaction recovery
- Comfortable working towards a multi-year vision with incremental deliverables
- Strong foundation in algorithms and data structures and their real-world use cases
- Experience driving company initiatives towards customer satisfaction
Benefits:
- Comprehensive benefits and perks that meet the needs of all employees
- Opportunities for professional growth and development
- Collaborative and dynamic work environment
- Recognition and rewards for outstanding performance
At Databricks, we strive to provide a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards.
For more fresh new jobs, check out yubhub.co.