Senior Data Engineer

Senior Data Engineer

Temporary 60750 - 74250 £ / year (est.) Remote
C

At a Glance

  • Tasks: Migrate complex SQL workloads to Databricks and optimise performance.
  • Company: Leading tech firm focused on innovative data solutions.
  • Benefits: Competitive daily rate, fully remote work, and flexible contract duration.
  • Other info: Opportunity for impactful work in a dynamic, remote environment.
  • Why this job: Join a critical project and enhance your data engineering skills.
  • Qualifications: Hands-on experience with Azure Synapse and Databricks required.

The predicted salary is between 60750 - 74250 £ per year.

Senior Data Engineer – Contract £600 per day | Outside IR35 | Fully Remote | 2-Month Contract | Start: 1st November We are looking for a highly experienced Senior Data Engineer to support a critical data platform migration project for one of our clients.

This is an initial 2-month contract , working fully remotely, with a target delivery date of the end of December.

The successful consultant will be responsible for migrating an existing Azure Synapse Dedicated SQL Pool codebase into Databricks, ensuring the migrated solution delivers equivalent or improved performance, maintains data accuracy and supports ongoing business consumption.

We are specifically looking for someone with hands-on experience migrating complex SQL workloads from Synapse Dedicated SQL Pools to Databricks , rather than general Databricks engineering experience alone.

Key Responsibilities Migrate approximately 72 T-SQL stored procedures from Azure Synapse Dedicated SQL Pool into Databricks.

Analyse existing SQL code, dependencies and execution patterns to determine the most effective migration approach.

Refactor and optimise complex T-SQL logic for Databricks SQL, Spark SQL and/or Py Spark.

Identify, remove and rework dependencies on existing Claims dimensional model fact and dimension tables.

Ensure migrated datasets and pipelines are available for downstream business consumption.

Address architectural differences between Synapse's MPP SQL processing engine and Databricks' Spark-based execution.

Optimise query execution, joins, data transformations and pipeline performance.

Deliver equivalent or improved pipeline performance following migration.

Perform comprehensive reconciliation and validation to ensure data accuracy and consistency with existing migration thresholds.

Troubleshoot migration issues and deliver a production-ready solution within the agreed timeline.

Essential Skills

Senior Data Engineer employer: Consult

At Consult, we pride ourselves on being an exceptional employer that fosters a dynamic and inclusive work culture. Our North America team is dedicated to professional growth, offering robust training and development opportunities while working in a fast-paced, innovative environment. Join us to be part of a collaborative team that values your contributions and supports your career aspirations in the exciting MedTech sector.

C

Contact Details:

Consult Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior Data Engineer

✨Tap into Online Data Science Communities

Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like Consult before they're even advertised!

✨Show Off Your Skills With Projects

Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.

✨Check Out Specialist Job Boards

For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like Consult.

✨Leverage University Resources

If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like Consult.

We think you need these skills to ace Senior Data Engineer

Python
SQL
Communication Skills
Problem-Solving Skills
Data Engineering
Data Warehousing
Data Pipeline Development

Some tips for your application 🫡

Highlight Your Data Projects:When applying for a temporary data science role at Consult, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.

Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!

Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to Consult, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.

Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab Consult’s attention and show the tangible impact of your work.

How to prepare for a job interview at Consult

✨Showcase Your Analytical Skills

For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at Consult.

✨Brush Up on Technical Skills

You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.

✨Highlight Your Adaptability

Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at Consult.

✨Prepare a Portfolio of Your Work

Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at Consult.