At a Glance
- Tasks: Design and optimise data flows, build robust data pipelines, and ensure data quality.
- Company: Join a leading public sector organisation in London with a focus on innovation.
- Benefits: Competitive salary, hybrid work model, and opportunities for professional growth.
- Why this job: Make a real impact by shaping data solutions that drive business intelligence.
- Qualifications: Strong SQL skills and experience with Databricks and ETL processes.
- Other info: Collaborative environment with a focus on continuous learning and development.
The predicted salary is between 42000 - 84000 £ per year.
Morgan Hunt is partnering with a public sector organisation in London to recruit an Azure Data Engineer on a permanent basis. This is a key role focused on leading the implementation of data flows that connect operational systems with analytics and business intelligence platforms. You will design, build, and maintain the organisation's data infrastructure, ensuring large datasets are processed, stored, and accessed efficiently and securely. The successful candidate will bring a strong grounding in data engineering best practices and data architecture, along with the ability to collaborate effectively across technical and non-technical teams to deliver high-quality, scalable data solutions.
Key Responsibilities
- Design & Development
- Design, develop, and optimise ETL processes using Databricks
- Build robust data pipelines to extract, transform, and load data into data lakes and other storage solutions
- Implement best practices for data management, governance, and data quality assurance
- Data Infrastructure
- Build and maintain scalable, secure, and well-structured data architectures
- Integrate multiple data platforms and tools to create a cohesive data ecosystem
- Monitor, troubleshoot, and resolve data pipeline issues to ensure high availability and reliability
- Collaboration
- Work closely with data scientists, analysts, and stakeholders to understand requirements and deliver effective solutions
- Develop a strong understanding of business problems and data use cases
- Collaborate with IT, Digital, and DevOps teams to support deployment and integration
- Innovation
- Stay up to date with emerging trends in data engineering, platforms, and big data technologies
- Continuously review, evaluate, and improve existing data processes
Essential Experience
- Advanced SQL skills
- Strong experience with Databricks, including Spark, Delta Lake, and MLflow
- Proven experience migrating SSIS to Databricks
- In-depth understanding of ETL/ELT processes
- Solid knowledge of data warehousing concepts and architectures
- Ability to design and deliver data models across multiple subject areas
- Experience implementing data governance, security, and compliance standards to ensure data accuracy and integrity
Azure Data Engineer employer: Morgan Hunt UK Limited
Contact Detail:
Morgan Hunt UK Limited Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Azure Data Engineer
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Azure. A friendly chat can lead to insider info about job openings or even referrals.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best projects, especially those involving Databricks and ETL processes. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering questions. Be ready to discuss your experience with SQL, data pipelines, and how you've tackled challenges in past projects. Confidence is key!
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities that might be perfect for you. Plus, it’s a great way to ensure your application gets seen by the right people.
We think you need these skills to ace Azure Data Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Azure Data Engineer role. Highlight your experience with Databricks, SQL, and any relevant data engineering projects. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about data engineering and how you can contribute to our team. Keep it concise but impactful – we love a good story!
Showcase Your Projects: If you've worked on any cool data projects, make sure to mention them! Whether it's building data pipelines or optimising ETL processes, we want to know what you've done and how it relates to the role.
Apply Through Our Website: Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it makes the whole process smoother for everyone involved.
How to prepare for a job interview at Morgan Hunt UK Limited
✨Know Your Tech Inside Out
Make sure you brush up on your SQL skills and get familiar with Databricks, Spark, and Delta Lake. Be ready to discuss how you've used these technologies in past projects, especially when it comes to ETL processes and data governance.
✨Showcase Your Problem-Solving Skills
Prepare examples of how you've tackled data pipeline issues or optimised data architectures in previous roles. Highlight your ability to troubleshoot and ensure high availability, as this will resonate well with the interviewers.
✨Collaboration is Key
Be ready to talk about your experience working with cross-functional teams, including data scientists and analysts. Share specific instances where you’ve collaborated to deliver effective data solutions that meet business needs.
✨Stay Ahead of the Curve
Demonstrate your passion for the field by discussing recent trends in data engineering and big data technologies. Showing that you're proactive about learning and improving existing processes can set you apart from other candidates.