At a Glance
- Tasks: Design and build data pipelines, manage data infrastructure, and implement CI/CD processes.
- Company: Join a global leader in digital communications with a supportive culture.
- Benefits: Generous leave, flexible hybrid work, unlimited development budget, and competitive salary.
- Other info: Enjoy a dynamic environment with excellent career growth opportunities and fun team socials.
- Why this job: Make a real impact on global data strategy while working with cutting-edge technologies.
- Qualifications: Expertise in Azure, Databricks, Python, and strong data engineering skills required.
The predicted salary is between 45000 - 75000 £ per year.
Location: UK (Flexible Hybrid)
Salary: Up to £75,000 + Benefits
Are you an engineer who loves working with Databricks? Do you get excited by writing production-grade code to build, scale, and solve complex data platform challenges?
I'm hiring for a global leader in the digital communications space. Their high-throughput platforms process billions of critical messages annually for businesses worldwide. This is a high-scale environment where your work will directly build the future of their global data strategy.
We are looking for a Senior Data Engineer to design, build, and own the data backbone of their global platforms. Your mission will be to engineer the critical data pipelines and warehousing solutions that transform billions of messages into trustworthy, actionable insights.
What You’ll Actually Do:
- Design & Build Data Pipelines: Take full ownership of designing, building, and managing the full lifecycle of complex data pipelines using Azure Data Factory, Databricks (Python/PySpark), and advanced SQL.
- Productionise Databricks: Lead the development of robust, scalable solutions on Databricks. This role is focused on production code, Delta Lake, Structured Streaming, and Spark performance tuning—not just ad-hoc notebooks.
- Champion DataOps & CI/CD: Implement and manage CI/CD processes for data pipelines using Azure DevOps. You will be responsible for automating testing, validation, and deployment to ensure data is reliable and trustworthy.
- Engineer the Data Warehouse: Design and build scalable data models (e.g., medallion architecture, dimensional models) to support analytical workloads, ensuring data is optimised for BI and reporting.
- Manage Data Infrastructure: Configure and optimize the underlying data infrastructure from a data engineering lens. This includes managing Databricks clusters, Spark configurations, and ADLS Gen2 storage to ensure high performance and cost-efficiency.
- Partner Across the Business: Partner with Data Analysts, Product Managers, and business leaders to translate requirements into technical designs. You will be the expert voice on data availability, quality, and governance.
What You’ll Need:
- Azure Data Expertise: Deep experience in the Microsoft Azure data ecosystem, especially Azure Data Factory, Databricks, and ADLS Gen2.
- Must-Have Databricks Expertise: Strong, hands-on, commercial experience with production-grade Databricks. You must be someone who lives in code, understands distributed systems, and can performance tune complex Spark jobs.
- Strong DataOps / CI/CD Experience: A proven background in implementing and managing CI/CD pipelines for data solutions, specifically using Azure DevOps.
- Expert Programming Skills: Expert-level skills for data transformation and automation, especially in Python (PySpark) and advanced SQL.
- Data Warehousing & Modelling: Proven experience in data warehousing principles and designing data models (e.g., dimensional, medallion) to support analytics.
- Exceptional Communication: The ability to translate complex data concepts and trade-offs to non-technical stakeholders, building trust and consensus.
- Data Infrastructure Knowledge: Experience with Infrastructure as Code (e.g., Terraform) for managing data resources is a significant plus.
What’s In It For You?
- Generous Leave: 27 days holiday + bank holidays + an extra day off for your birthday.
- Work-Life Balance: True flexible hybrid working. Once a month meet-ups, if that.
- Growth: An unlimited budget for your professional and personal development.
- Financial & Family: A basic salary up to £75,000. Enhanced family leave, retirement planning, healthcare, and life assurance.
- Culture: A great, supportive culture with paid volunteer days ("giving back" days) and fun team socials.
This is a chance to join a stable, global leader and do real, production-grade data engineering.
Interested? Apply now to find out more.
Senior Data Engineer employer: KDR Talent Solutions
Join a global leader in digital communications that prioritises employee growth and well-being. With a generous benefits package including 27 days of holiday, flexible hybrid working, and an unlimited budget for professional development, this company fosters a supportive culture where your contributions directly impact the future of their data strategy. Experience a workplace that values work-life balance and encourages community involvement through paid volunteer days.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Data Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at meetups. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks and Azure. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Practice explaining complex data concepts in simple terms, as you'll need to communicate effectively with non-technical stakeholders.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Senior Data Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with Azure, Databricks, and data pipelines. We want to see how your skills match what we're looking for!
Showcase Your Projects:Include specific projects where you've designed and built data pipelines or worked with Databricks. We love seeing real examples of your work that demonstrate your expertise in production-grade code.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for key achievements and avoid jargon unless it's relevant. We appreciate straightforward communication!
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!
How to prepare for a job interview at KDR Talent Solutions
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure Data Factory, Databricks, and the specifics of Python/PySpark. Brush up on your knowledge of data pipelines and warehousing solutions, as you'll likely be asked to discuss your hands-on experience with these technologies.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific challenges you've faced in previous roles, especially those related to performance tuning and CI/CD processes. Use real examples to illustrate how you approached these problems and the impact of your solutions.
✨Communicate Clearly and Confidently
Since you'll need to partner with non-technical stakeholders, practice explaining complex data concepts in simple terms. This will demonstrate your ability to build trust and consensus across teams, which is crucial for this role.
✨Ask Insightful Questions
Prepare thoughtful questions about the company's data strategy and how they envision the role of a Senior Data Engineer. This shows your genuine interest in the position and helps you assess if the company aligns with your career goals.
