Data Engineer

Role Title : Data Engineer

Role Type : Contract (inside ir35)

Role Location : London, UK

Mandatory : Active Security Clearance

Essential Skills & Experience

• 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.
• Good proficiency in Python and Spark (PySpark) or Scala.
• Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.
• Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database.
• Experience working with large datasets and complex data pipelines.
• Experience with data architecture design and data pipeline optimization.
• Proven expertise with Databricks, including hands-on implementation experience and certifications.
• Experience with SQL and NoSQL databases.
• Experience with data quality and data governance processes.
• Experience with version control systems (e.g., Git).
• Experience with Agile development methodologies