At a Glance
- Tasks: Build and optimise data pipelines using SQL, Python, Spark, and Azure tools.
- Company: Join a dynamic team providing services to Microsoft through Allegis Global Solutions.
- Benefits: Competitive pay, hybrid work model, and hands-on experience with cutting-edge technologies.
- Other info: 12-month contract with excellent career growth opportunities in a collaborative environment.
- Why this job: Make an impact by improving data processes and working with industry-leading tools.
- Qualifications: Strong coding skills in SQL and Python; experience with data pipelines and Agile teams.
The predicted salary is between 39600 - 40950 £ per year.
This contract role provides services to Microsoft through external staffing partners of Allegis Global Solutions (AGS). If you are selected for this role, you will be employed by AGS and will not be an employee of Microsoft.
Summary: This role is for a hands‑on Data Engineer focused on building and improving data pipelines using SQL, Python, Spark, and Azure tools such as Databricks and Azure Data Factory. The individual will work under senior guidance to deliver reliable, high‑quality ETL/ELT pipelines and support ongoing modernization efforts. They will also handle pipeline optimisation, data quality checks, and production issue troubleshooting. The role involves contributing to workflow improvements, implementing governance changes like Unity Catalog, and maintaining clear technical documentation. Overall, it requires strong coding skills, problem‑solving ability, and experience working in agile, production environments.
Key Qualifications & Responsibilities:
- Build and maintain data pipelines (ETL/ELT) using SQL, Python, Spark
- Work on Databricks and Azure Data Factory (ADF) pipelines
- Support Unity Catalog migration tasks
- Improve existing pipelines (performance, reliability, efficiency)
- Add data quality checks and monitoring alerts
- Troubleshoot pipeline failures and production issues
- Follow existing workflow/orchestration standards
- Write documentation, runbooks, and operational notes
Preferred Qualifications:
- Strong SQL + Python hands‑on experience
- Working experience with Apache Spark
- Experience in Azure Databricks + Azure Data Factory (ADF)
- Experience building and maintaining data pipelines
- Experience with Git (code reviews, PRs, collaboration)
- Ability to debug pipeline failures and data issues
- Experience working in Agile delivery teams
Desired Qualifications:
- Exposure to Unity Catalog / data governance frameworks
- Experience with Azure DevOps
- Exposure to event‑driven / telemetry data systems
Additional Details:
- Location: Atherstone, England
- Duration: 12 months
- Shift Timings: Hybrid (Hours minimum 10‑4pm; 3 days / week onsite)
- Weekly Schedule: 40 hours
- Pay Range: £180/day to £195/day (PAYE)
Data Engineer (contract) employer: Microsoft
Microsoft in Oxford is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. Employees benefit from competitive compensation, a supportive environment, and ample opportunities for professional growth, making it an ideal place for those looking to advance their careers in cloud solutions. The strategic location in Oxford further enhances the experience, providing access to a vibrant tech community and rich cultural resources.
