Azure Data Engineer Location: Coventry - Hybrid - 3 days per week onsite Start Date: ASAP Contract Rate: £420 per day inside IR35 Duration: 6 to 12 months initially Role Overview Our client is seeking a highly skilled Azure Data Engineer to design, develop, and execute enterprise-scale data migration and transformation solutions within the Microsoft Azure ecosystem. The successful candidate will play a key role in building high-performance data pipelines, enabling scalable data processing, and supporting critical business data initiatives. Key Responsibilities * Design and build scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines * Develop structured data migration payloads, including schema mapping and transformation logic * Implement Change Data Capture (CDC) for efficient incremental data loads * Develop and maintain PySpark notebooks for data transformation, cleansing, and partitioning * Build reusable Python utilities for data validation and API integrations * Create and optimise SQL queries, stored procedures, and analytical data models * Manage and integrate data across Azure Data Lake (ADLS Gen2), Synapse Analytics, and Azure SQL * Design solutions for handling structured and semi-structured data formats such as JSON and Delta Lake * Ensure performance optimisation, scalability, and reliability of data pipelines * Support data quality, governance, and security best practices Skills & Experience Essential * 5+ years’ experience in cloud data engineering, ideally within Azure * Strong hands-on expertise with Azure Data Factory and Azure Synapse Analytics * Advanced programming skills in Python, PySpark, and SQL (T-SQL / Spark SQL) * Experience designing and implementing data pipelines and migration solutions * Strong understanding of data modelling, transformations, and optimisation techniques * Experience working with Azure Data Lake Storage (ADLS Gen2) Desirable * Experience with Azure Databricks * Familiarity with Cosmos DB, Oracle DB, and Delta Lake * Knowledge of event-driven architectures (Event Hub, Kafka, IoT Hub) * Exposure to Microsoft Fabric / OneLake * CI/CD experience with Azure DevOps or GitHub * Understanding of data governance, data quality, and security frameworks * Experience working with unstructured data and large-scale datasets If you have the relevant skills and experience, please do apply promptly to be considered
Contact Details:
Queen Square Recruitment Ltd Recruitment Team
