Description
We are seeking a Staff Software Engineer to join our team in Belgrade, Serbia. As a Staff Software Engineer, you will be part of a multi-year journey to design and build the next-generation query engine and structured storage system.
Our mission at Databricks is to simplify the data lifecycle from ingestion to ETL, BI, and ML/AI with a unified platform. We believe the data warehouse architecture will be replaced by a new architectural pattern, Lakehouse, which unifies data warehousing and advanced analytics.
The new architecture will help address several major challenges, including data staleness, reliability, total cost of ownership, data lock-in, and limited use-case support. To achieve this vision, we are building a decoupled query engine and structured storage system that can outperform specialized data warehouses in relational query performance.
As a Staff Software Engineer, you will design these next-generation systems that leapfrog state-of-the-art within the following areas:
- Query compilation and optimization
- Distributed query execution and scheduling
- Vectorized execution engine
- Data security
- Resource management
- Transaction coordination
- Efficient storage structures (encodings, indexes)
- Automatic physical data optimization
Your responsibilities will include driving requirements clarity and design decisions for ambiguous problems, producing technical design documents and project plans, developing new features, mentoring more junior engineers, testing and rolling out to production, and monitoring.
We look for a passion for database systems, storage systems, distributed systems, language design, or performance optimization. You should be comfortable working towards a multi-year vision with incremental deliverables, be customer-oriented and focused on having an impact, and have 7+ years of experience working in a related system. A PhD in databases or distributed systems is optional.