Associate Data Engineer

Job Description

You'll be joining the Applications team, which is an Engineering function within Quantexa's R&D department that is focused on internally building real-world applications of the Quantexa Platform.

This function enables demonstrations of the product and develops SaaS offerings, whilst also testing and refining new Platform features before they are deployed by clients. The function develops and releases its own tools that feed into these internal applications and are also packaged and released to help standardize and accelerate all Quantexa deployments.

It encompasses four distinct sub-teams:

Data Engineering Accelerators

• Developing Quantexa's libraries for cleansing, parsing and standardising data used in entity resolution
• Finding efficiency/performance improvements through big data testing and building performance tooling
• Owning best practices in entity resolution and network building

Data Feeds

• Building standardised and reusable code for processing various third party/open source data sets
• Managing an internal data lake for the provision of this data by other teams for testing and analytics
• Owning general best practices for ingesting and processing data to get it ready for use in the Quantexa Platform, including pipelines and scheduling

Demos

• Developing, deploying and maintaining all Quantexa demos, showcasing the different use cases for the Quantexa Platform
• Owning the Quantexa Trial platform, for prospective Quantexa clients to see the product in action using real data provided by Data Feeds
• Building tools to enable solution owners and sales to create their own custom demos

SaaS

• Building Quantexa's emerging SaaS offering, a cloud hosted, standardized deployment of the Quantexa Platform
• Targeting mid-market banks in the US for Retail AML initially, providing them with a cost-effective Quantexa solution, then expanding in future to more use cases and geographies
• Implementing cutting edge features of the Quantexa Platform ensuring SaaS customers always on the latest and greatest of Quantexa

Requirements

• Data processing/ETL pipelines
• Analysing and examining real and varied data
• Full stack development, but with a heavy focus on the data processing/ETL side
• Solving difficult problems with efficient, resilient, high impact code
• Working in the cloud with production-grade systems
• Defining best-practices and sharing expertise you’ve developed
• Working in a fast moving, Agile environment
• Growing and thriving within one of the UK’s fastest growing scale-ups

Experience in the following would be beneficial:

• A strong coding background, ideally in Scala or otherwise in a relevant language that will allow you to learn Scala quickly (e.g. Java/Python)
• Big data, either from a software deployment/implementation or a data science perspective
• Working with big data technology, ideally Spark but others will also be useful such as Airflow or Elasticsearch
• Working in an Agile environment
• Building data processing pipelines for use in production batch systems, including either traditional ETL pipelines and/or analytics pipelines
• Manipulating data through cleansing, parsing, standardising etc, especially in relation to improving data quality/integrity
• Building and deploying SaaS products

Benefits

• Competitive salary and Company Bonus
• Flexible working hours in a hybrid workplace & free access to global WeWork locations & events
• Pension Scheme with a company contribution of 6% (if you contribute 3%)
• 25 days annual leave (with the option to buy up to 5 days) + birthday off!
• Work from Anywhere Scheme: Spend up to 2 months working outside of your country of employment over a rolling 12-month period
• Family: Enhanced Maternity, Paternity, Adoption, or Shared Parental Leave
• Private Healthcare with AXA
• EAP, Well-being Days, Gym Discounts
• Free Calm App Subscription #1 app for meditation, relaxation and sleep
• Workplace Nursery Scheme
• Team's Social Budget & Company-wide Summer & Winter Parties
• Tech & Cycle-to-Work Schemes
• Volunteer Day off
• Dog-friendly Offices