At a Glance
- Tasks: Design and build data pipelines, manage data infrastructure, and implement CI/CD processes.
- Company: Join a global leader in digital communications with a supportive culture.
- Benefits: Up to £75,000 salary, 27 days holiday, flexible hybrid work, and unlimited development budget.
- Other info: Enjoy a fun team culture with paid volunteer days and monthly meet-ups.
- Why this job: Make a real impact on global data strategy while working with cutting-edge technologies.
- Qualifications: Expertise in Azure, Databricks, Python, and data warehousing principles required.
The predicted salary is between 45000 - 75000 £ per year.
Location: UK (Flexible Hybrid)
Salary: Up to £75,000 + Benefits
Are you an engineer who loves working with Databricks? Do you get excited by writing production-grade code to build, scale, and solve complex data platform challenges?
I'm hiring for a global leader in the digital communications space. Their high-throughput platforms process billions of critical messages annually for businesses worldwide. This is a high-scale environment where your work will directly build the future of their global data strategy.
We are looking for a Senior Data Engineer to design, build, and own the data backbone of their global platforms. Your mission will be to engineer the critical data pipelines and warehousing solutions that transform billions of messages into trustworthy, actionable insights.
What You'll Actually Do:
- Design & Build Data Pipelines: Take full ownership of designing, building, and managing the full lifecycle of complex data pipelines using Azure Data Factory, Databricks (Python/PySpark), and advanced SQL.
- Productionise Databricks: Lead the development of robust, scalable solutions on Databricks. This role is focused on production code, Delta Lake, Structured Streaming, and Spark performance tuning—not just ad-hoc notebooks.
- Champion DataOps & CI/CD: Implement and manage CI/CD processes for data pipelines using Azure DevOps. You will be responsible for automating testing, validation, and deployment to ensure data is reliable and trustworthy.
- Engineer the Data Warehouse: Design and build scalable data models (e.g., medallion architecture, dimensional models) to support analytical workloads, ensuring data is optimised for BI and reporting.
- Manage Data Infrastructure: Configure and optimize the underlying data infrastructure from a data engineering lens. This includes managing Databricks clusters, Spark configurations, and ADLS Gen2 storage to ensure high performance and cost-efficiency.
- Partner Across the Business: Partner with Data Analysts, Product Managers, and business leaders to translate requirements into technical designs. You will be the expert voice on data availability, quality, and governance.
What You'll Need:
- Azure Data Expertise: Deep experience in the Microsoft Azure data ecosystem, especially Azure Data Factory, Databricks, and ADLS Gen2.
- Must-Have Databricks Expertise: Strong, hands-on, commercial experience with production-grade Databricks. You must be someone who lives in code, understands distributed systems, and can performance tune complex Spark jobs.
- Strong DataOps / CI/CD Experience: A proven background in implementing and managing CI/CD pipelines for data solutions, specifically using Azure DevOps.
- Expert Programming Skills: Expert-level skills for data transformation and automation, especially in Python (PySpark) and advanced SQL.
- Data Warehousing & Modelling: Proven experience in data warehousing principles and designing data models (e.g., dimensional, medallion) to support analytics.
- Exceptional Communication: The ability to translate complex data concepts and trade-offs to non-technical stakeholders, building trust and consensus.
- Data Infrastructure Knowledge: Experience with Infrastructure as Code (e.g., Terraform) for managing data resources is a significant plus.
What's In It For You?
- Generous Leave: 27 days holiday + bank holidays + an extra day off for your birthday.
- Work-Life Balance: True flexible hybrid working. Once a month meet-ups, if that.
- Growth: An unlimited budget for your professional and personal development.
- Financial & Family: A basic salary up to £75,000. Enhanced family leave, retirement planning, healthcare, and life assurance.
- Culture: A great, supportive culture with paid volunteer days ("giving back" days) and fun team socials.
This is a chance to join a stable, global leader and do real, production-grade data engineering.
Interested? Apply now to find out more.
Senior Data Engineer in England employer: KDR Talent Solutions
Join a globally recognised tech organisation as a Senior Infrastructure Engineer, where you'll thrive in a culture that champions autonomy, innovation, and continuous learning. With a focus on cutting-edge technology and a collaborative environment, you'll have the opportunity to influence technical decisions and work alongside world-class specialists while enjoying a hybrid working model based in Manchester. The company offers significant employee growth opportunities, including exposure to AI and cyber security projects, making it an excellent employer for those passionate about infrastructure and technology.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Data Engineer in England
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at meetups. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your data engineering projects, especially those involving Azure and Databricks. This will give potential employers a taste of what you can do.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Practice explaining complex data concepts in simple terms—this is key when talking to non-technical stakeholders.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Senior Data Engineer in England
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with Azure, Databricks, and data pipelines. We want to see how your skills match what we're looking for!
Showcase Your Projects:Include specific projects where you've designed and built data pipelines or worked with Databricks. We love seeing real examples of your work that demonstrate your expertise and problem-solving skills.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for key achievements and avoid jargon unless it's relevant. We appreciate straightforward communication!
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!
How to prepare for a job interview at KDR Talent Solutions
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure Data Factory, Databricks, and the tools mentioned in the job description. Brush up on your Python (PySpark) and SQL skills, as you’ll likely be asked to demonstrate your expertise in these areas during the interview.
✨Showcase Your Projects
Prepare to discuss specific projects where you've designed and built data pipelines or worked with Databricks. Be ready to explain the challenges you faced, how you overcame them, and the impact your work had on the business. Real-world examples will make you stand out!
✨Understand DataOps and CI/CD
Since this role emphasises DataOps and CI/CD, be prepared to talk about your experience implementing these processes. Share any tools you’ve used, like Azure DevOps, and how you’ve automated testing and deployment in your previous roles.
✨Communicate Clearly
You’ll need to translate complex data concepts to non-technical stakeholders, so practice explaining your work in simple terms. Think about how you can build trust and consensus with your audience, as this is key to being successful in the role.
