Description
As a Data Platform Operations Engineer, your primary focus will be monitoring and maintaining availability, performance, scalability, and reliability of the Data Platform to meet the SLAs and needs of internal and external customers.
In addition, you will be working on automation and improving site reliability utilising a variety of tooling and technologies. You will also be assisting with work Data Quality and Data Assurance, including operational support of reconciliation platforms and processes.
Operational
- Ensure system reliability, uptime, and scalability while delivering changes.
- Collaborate with cross-functional teams (Data & Analytics, Security, etc.) to uphold best practices.
- Monitor performance, resolve issues proactively, and maintain a knowledge base for troubleshooting.
- Manage deployments, data pipeline stability, and dashboard refreshes.
- Implement security, compliance, and data governance frameworks (e.g., data integrity, privacy, lifecycle management).
- Maintain documentation, stay updated on industry trends, and support disaster recovery planning.
- Optimize the Datactics data quality platform and manage data reconciliation/governance processes.
- Participate in on-call rotations for out-of-hours support.
Engineering
- Design, deploy, and maintain monitoring dashboards and SRE frameworks.
- Automate and modernize operational processes for the Data Platform.
- Leverage AI (Generative/Agentic) and automation to enhance efficiency and self-healing capabilities.
- Reduce out-of-hours support needs through engineering and AI toolsets.
What do you need to succeed? Must-have
- Experience supporting scalable, high-performance data platforms in hybrid (Azure) environments, including data lifecycle management, RDBMS, NoSQL, data warehouses, and cloud infrastructure principles.
- Hands-on experience with SQL/ETL tools, CI/CD, DevOps, monitoring/logging, data security/governance (e.g., Purview, Collibra), and version control (Git).
- Familiarity with Agile methodologies and ITSM tools (e.g., ServiceNow, Jira).
- Incident management experience, with an understanding of high availability/disaster recovery, and application of ITSM principles.
- Excellent communication, organisational, and interpersonal skills, with the ability to collaborate across teams and produce concise documentation for technical and non-technical audiences.
- Engineering experience, particularly with Site Reliability Engineering (SRE), and the ability to work under tight deadlines.
- Databases & Tools knowledge: Microsoft SQL Server (administration, T-SQL, DML, DDL, SSIS), Databricks, Power BI.
- Experience in Azure Technologies: ADLS, ADF, Azure SQL Database, Delta Lake, Azure DevOps, Logic Apps, Function Apps, Key Vaults, Storage Accounts.
- Infrastructure & Automation: Terraform, Python/PySpark.
- Expertise in data modeling, integration, ETL processes, governance, and security.
Nice-to-have
- Experience with Datactics (or similar platforms) and Generative/Agentic AI is a plus.
- Degree in Computer Science, Engineering, IT, or related fields is advantageous.
What is in it for you?
- A comprehensive Total Rewards Program including bonuses, flexible benefits and competitive compensation
- Leaders who support your development through coaching and managing opportunities
- Opportunities to work with the best in the field
- Ability to make a difference and lasting impact
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services.