Azure Databricks Developer (SC / NPPv3) in London

Azure Databricks Developer (SC / NPPv3) in London

London Full-Time 63000 - 77000 £ / year (est.) On-site
Hays Specialist Recruitment Limited Careers

At a Glance

  • Tasks: Design and develop scalable data engineering solutions using Azure Databricks.
  • Company: Join a leading tech firm focused on innovative data solutions.
  • Benefits: Competitive pay, flexible working, and opportunities for professional growth.
  • Other info: Collaborative environment with a focus on career advancement.
  • Why this job: Make an impact by building advanced analytics and AI solutions.
  • Qualifications: Experience with Azure Databricks, PySpark, and data pipeline development.

The predicted salary is between 63000 - 77000 £ per year.

Our key client is looking for an Azure Databricks Developer with SC and NPPv3 on a 6 months+ contract. The Azure Databricks Developer is responsible for designing, developing, testing and supporting scalable data engineering solutions using Azure Databricks and the wider Azure data platform. The role focuses on building robust data ingestion, transformation and processing pipelines that enable advanced analytics, AI, machine learning and business intelligence solutions. Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, the Azure Databricks Developer helps deliver trusted, high-quality data products while ensuring adherence to security, governance and operational standards.

Requirement: NPPV3/SC clearance

Key Responsibilities

  • Data Engineering & Development
    • Design and develop data pipelines using Azure Databricks.
    • Build scalable ETL/ELT solutions using PySpark, Spark SQL and Delta Lake.
    • Develop ingestion frameworks for batch and streaming data.
    • Develop outbound pipelines that interface with APIs.
    • Optimise large-scale data processing workloads for performance and cost efficiency.
  • Data Integration
    • Integrate data from Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric APIs and third-party SaaS platforms, on-premise systems, and event streaming platforms.
    • Implement automated data validation and reconciliation processes.
  • Data Modelling
    • Implement bronze, silver and gold data architectures.
    • Optimise storage structures using Delta Lake best practices.
  • Platform Engineering
    • Configure and maintain Databricks workspaces, clusters and compute resources.
    • Implement CI/CD pipelines for Databricks code deployments.
    • Support environment promotion across development, test and production environments.
    • Monitor and troubleshoot platform performance issues.
  • Data Quality & Governance
    • Implement data quality controls.
    • Support metadata management and lineage requirements.
    • Ensure compliance with security, privacy and governance standards.
    • Contribute to data catalogue and documentation activities.
  • Collaboration
    • Work with business stakeholders to understand data requirements.
    • Support Data Architects in implementing target-state architectures.

Technical Skills

Essential

  • Azure Databricks
  • Apache Spark
  • PySpark
  • Spark SQL
  • Delta Lake
  • Azure Data Lake Storage Gen2
  • Azure Data Factory or Microsoft Fabric Data Factory
  • Git version control
  • SQL development
  • Python programming

Desirable

  • Microsoft Fabric
  • Azure Synapse Analytics
  • Azure Event Hubs
  • Kafka
  • Power BI
  • Databricks Workflows
  • Azure DevOps
  • Terraform
  • Unity Catalog
  • MLflow
  • Azure Machine Learning

Experience Profile

Candidates should demonstrate experience in:

  • Developing enterprise-scale data pipelines.
  • Working with large data volumes and distributed processing technologies.
  • Building ETL/ELT solutions within Azure environments.
  • Implementing data quality and monitoring controls.
  • Working within Agile delivery teams.

Key Competencies

  • Technical
  • Analytical problem solving
  • Performance optimisation
  • Data architecture awareness
  • Software engineering practices
  • Testing and quality assurance

Azure Databricks Developer (SC / NPPv3) in London employer: Hays Specialist Recruitment Limited Careers

Hays Education is an exceptional employer, offering a supportive and collaborative work environment for SEN SLD/PMLD teachers in the Hounslow/Hillingdon area. With access to exclusive vacancies, ongoing professional development, and a dedicated consultant to guide your career, you will find ample opportunities for growth while making a meaningful impact on the lives of pupils with special educational needs. Join us to be part of a community that values inclusivity and fosters both personal and professional development.

Hays Specialist Recruitment Limited Careers

Contact Details:

Hays Specialist Recruitment Limited Careers Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Azure Databricks Developer (SC / NPPv3) in London

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Hays Specialist Recruitment Limited Careers!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Azure Databricks Developer (SC / NPPv3) at Hays Specialist Recruitment Limited Careers.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Hays Specialist Recruitment Limited Careers.

✨Apply Directly through Our Website

When you find a suitable opening like Azure Databricks Developer (SC / NPPv3) at Hays Specialist Recruitment Limited Careers, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Azure Databricks Developer (SC / NPPv3) in London

SQL
Python
Data Engineering
Communication Skills
Data Quality Assurance
Problem-Solving Skills
ETL/ELT Processes

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at Hays Specialist Recruitment Limited Careers, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Hays Specialist Recruitment Limited Careers. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at Hays Specialist Recruitment Limited Careers

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Hays Specialist Recruitment Limited Careers!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.