Databricks Architect

We are seeking a Databricks Architect to join our team. As a Databricks Architect, you will help clients transform fragmented data into AI-ready lakehouse platforms. You’ll advise on architecture across Databricks and cloud ecosystems, covering data products, governance, metadata, lineage, semantic layers and GenAI data patterns.

Responsibilities:

• Design and deliver modern data lakehouse solutions using Databricks, Delta Lake, Unity Catalog, PySpark, Spark SQL, and cloud data services.
• Define end-to-end architecture covering ingestion, transformation, data modelling, governance, security, orchestration, monitoring, and consumption.
• Build reusable patterns for batch, streaming, and near-real-time data pipelines.
• Implement strong data governance using Unity Catalog, including access control, lineage, cataloguing, and data ownership.
• Work with cloud platforms such as Azure, AWS, or GCP and integrate Databricks with tools like ADF, Power BI, Purview, Snowflake, dbt, Kafka, and APIs.
• Guide teams on performance tuning, cost optimisation, cluster strategy, job scheduling, and production support.
• Drive DevOps/DataOps practices using CI/CD, Git, Terraform, Databricks workflows, and automated deployment.
• Lead architecture discussions, review solution designs, mentor engineers, and engage confidently with senior stakeholders.

Requirements:

• Strong hands-on experience with Databricks Lakehouse Platform.
• Deep knowledge of Spark, PySpark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Auto Loader, and Delta Live Tables.
• Experience designing scalable data platforms on Azure, AWS, or GCP.
• Good understanding of data engineering, data modelling, data quality, security, and governance.
• Experience with CI/CD, Terraform, Git, monitoring, and operational support.
• Strong communication skills with the ability to explain complex technical topics clearly.

Benefits: Industry-leading compensation and benefits, along with top training and development opportunities.