At a Glance
- Tasks: Lead migration from Matillion to Azure Data Factory and design high-performance data pipelines.
- Company: Join a forward-thinking tech company focused on data innovation.
- Benefits: Attractive salary, flexible working options, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on innovation and career advancement.
- Why this job: Be at the forefront of data transformation and make a significant impact.
- Qualifications: 10-15 years in ETL/Data Engineering with strong Azure and SQL skills.
The predicted salary is between 60000 - 80000 £ per year.
Role: Senior Data Engineer - Matillion to Azure Migration
Key Responsibilities
- Lead end-to-end migration strategy and execution from Matillon (Snowflake/Redshift) to Azure Data Factory, Synapse, and ADLS Gen2
- Analyse and convert Matillon ETL workflows (SQL, Python-based) into:
- Mapping Data Flows
- Databricks notebooks
- Design and develop scalable, high-performance data pipelines on Azure
- Drive performance optimisation to reduce ETL runtime and cost
- Implement data quality checks, validation frameworks, and error handling
- Produce technical documentation including mapping, data flow designs, and migration strategy
Mandatory Skills:
- Strong hands-on experience with Matillon ETL
- Strong hands-on experience with Azure Data Factory (ADF)
- Extensive experience in SQL (complex queries, performance tuning, stored procedures)
- Proven experience with Azure ecosystem: ADLS Gen2
Experience:
- 10-15+ years in ETL/Data Engineering & Data Warehousing
- Strong stakeholder communication and collaboration skills
- Experience in Python / PySpark for data processing
- Experience with Git and Azure DevOps (CI/CD pipelines)
We think you need these skills to ace Azure Data factory engineer in Warwick
Matillion ETL
Azure Data Factory (ADF)
SQL
Performance Tuning
Stored Procedures
Azure Data Lake Storage Gen2 (ADLS Gen2)
Data Engineering
