Description
We are seeking a Senior Software Engineer I to design and develop scalable Finance data pipelines using Azure Databricks, ADF, PySpark/Python, and SQL. The ideal candidate will modernize legacy data processes, improve data quality and integration reliability, and implement automation to reduce manual effort and strengthen operational resilience.
Responsibilities:
- Design, develop and maintain scalable data ingestion and transformation pipelines across Finance systems using Azure Databricks, Azure Data Factory, Python, PySpark and SQL.
- Support integrations spanning MBS, Oracle Fusion, Salesforce and legacy Finance data platforms.
- Improve the reliability, monitoring and performance of critical financial data integrations.
- Build reusable engineering components and AI-enabled automation capabilities.
- Architect robust, scalable and high-performance batch and near-real-time data pipelines.
- Implement data validation, cleansing, lineage, metadata and governance controls.
- Collaborate with Finance stakeholders, data analysts, data scientists, product managers and engineering teams.
- Mentor junior engineers and contribute to engineering standards and reviews.
Requirements:
- Experience in Azure Data Factory (ADF), Azure Databricks, Python, PySpark, SQL.
- Experience in data quality and reconciliation, data modelling and architecture.
- Experience with Git and software engineering practices.
- Experience delivering reliable, scalable solutions in an enterprise environment.
Good to Have:
- Experience with machine learning workflows and integration of model outputs into governed data pipelines.
- Experience creating reusable data engineering accelerators or AI-enabled automation components.
- Experience with Power BI, Synapse, OCI, Essbase, Talend, HPCC/ECL or other enterprise analytics and data-integration technologies.
Expected Outcomes:
- Consolidated and modernized Finance data services within EDI and BDAP.
- Reduced reliance on legacy platforms, manual reconciliation and ageing infrastructure.
- Improved reliability, observability and performance of critical Finance integrations.
For more fresh new jobs, check out yubhub.co.