Azure Data Engineer: Build Scalable Data Pipelines

Azure Data Engineer: Build Scalable Data Pipelines

Freelance Home office (partial)
Involved Solutions

At a Glance

  • Tasks: Design and build scalable data pipelines on the Azure platform.
  • Company: Well-established consultancy driving high-impact data transformation.
  • Benefits: Up to £450/day, flexible remote work, and potential for extension.
  • Other info: Collaborative environment with opportunities for professional growth.
  • Why this job: Join a major Azure-led project and make a real impact in data engineering.
  • Qualifications: Experience with Azure Data Factory, Databricks, and SQL required.

We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. This role is Outside IR35 and offers £450/day, requiring 2 days onsite per week in Central London.

Key Responsibilities:
  • Design, build and maintain scalable and secure data pipelines on the Azure platform.
  • Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics.
  • Optimise ETL/ELT processes to improve performance, reliability and efficiency.
  • Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs.
  • Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data engineering.
  • Ensure compliance with data governance and security policies (incl. GDPR and ISO standards).
Required Skills & Experience:
  • Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure.
  • Azure Data Factory.
  • Azure Databricks (PySpark).
  • Azure Synapse Analytics.
  • Azure Data Lake Storage (Gen2).
  • SQL & Python.
  • Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps.
  • Experience working within consultancy or client-facing projects is highly desirable.

Interested? Apply now with your CV or reach out to discuss the opportunity further. This is a highly sought-after role for a consultant who wants to contribute to a major Azure-led data transformation programme.

Azure Data Engineer: Build Scalable Data Pipelines employer: Involved Solutions

Join a leading consultancy in Central London, where you will be part of a dynamic team driving impactful data transformation projects. With a strong focus on employee growth and collaboration, we offer a supportive work culture that values innovation and excellence. Enjoy the flexibility of working two days onsite while benefiting from competitive rates and opportunities for contract extension.

Involved Solutions

Contact Details:

Involved Solutions Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Azure Data Engineer: Build Scalable Data Pipelines

Tip Number 1

Network like a pro! Reach out to your connections in the industry, especially those who work with Azure or data engineering. A friendly chat can lead to insider info about job openings that aren't even advertised yet.

Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure Data Factory and Databricks. This gives potential employers a taste of what you can do and sets you apart from the crowd.

Tip Number 3

Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've optimised ETL processes or integrated data sources. We want to see your problem-solving skills in action!

Tip Number 4

Don't forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search.

We think you need these skills to ace Azure Data Engineer: Build Scalable Data Pipelines

Azure Data Factory
Azure Databricks (PySpark)
Azure Synapse Analytics
Azure Data Lake Storage (Gen2)
SQL
Python
ETL/ELT Optimisation

Some tips for your application 🫡

Tailor Your CV:Make sure your CV highlights your experience with Azure Data Factory, Databricks, and Synapse Analytics. We want to see how your skills match the job description, so don’t be shy about showcasing relevant projects!

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this role. Mention your experience in building scalable data pipelines and how you’ve optimised ETL processes in the past.

Showcase Your Collaboration Skills:Since this role involves working with Data Architects and Analysts, highlight any previous teamwork experiences. We love seeing how you’ve collaborated on projects to achieve common goals!

Apply Through Our Website:Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity. We can’t wait to hear from you!

How to prepare for a job interview at Involved Solutions

Know Your Azure Stuff

Make sure you brush up on your Azure Data Factory, Databricks, and Synapse Analytics skills. Be ready to discuss specific projects where you've built scalable data pipelines and how you optimised ETL/ELT processes.

Showcase Your Collaboration Skills

Since this role involves working with Data Architects and Analysts, be prepared to share examples of how you've successfully collaborated in the past. Highlight any experiences where you defined data models or ensured best practices in data engineering.

Understand Compliance and Security

Familiarise yourself with GDPR and ISO standards as they relate to data governance. Be ready to discuss how you've ensured compliance in previous roles, as this is crucial for the consultancy's projects.

Prepare for Technical Questions

Expect technical questions that test your knowledge of SQL, Python, and CI/CD processes in a data environment. Practise explaining complex concepts in simple terms, as you may need to communicate these ideas to non-technical stakeholders.