At a Glance
- Tasks: Design and optimise data pipelines using Azure Databricks for smarter decision-making.
- Company: Join Somerset Bridge Group, a leader in the insurance sector, driving innovation through data.
- Benefits: Enjoy hybrid working, generous leave, healthcare cash plan, and exclusive discounts.
- Other info: Flexible hours and a supportive culture make this role perfect for students.
- Why this job: Be part of a greenfield project that shapes the future of data in insurance.
- Qualifications: Experience with Azure Data Factory, Databricks, and strong SQL skills required.
The predicted salary is between 47000 - 61000 £ per year.
Location: Newcastle
Department: [SBSS] Enterprise Data Management
Location: Newcastle
Compensation: £53,000 - £67,000 / year
Description
At Somerset Bridge Group, we're transforming our data platform to create a modern, cloud-based data ecosystem that powers smarter decision-making across the business. As part of this journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation.
Joining our Enterprise Data Team, you'll play a key role in designing, building and optimising scalable data solutions that support Pricing, Underwriting, Claims and wider business operations. Working with large and complex datasets, you'll develop robust data pipelines and platforms that enable analytics, reporting, machine learning and AI-driven initiatives across the organisation.
You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance and security controls, optimising cloud-based data infrastructure, and supporting both real-time and batch data processing.
Working closely with Data Architects, Analysts, Pricing teams and Technology colleagues, you'll help shape the future of SBG's enterprise data platform, delivering scalable, secure and efficient solutions that support strategic business objectives and regulatory requirements.
This is an exciting opportunity to join a growing Enterprise Data Team and make a significant impact on the development of a modern Azure-based data platform, helping to drive data-led innovation across the business.
What you'll be responsible for:
- Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing.
- Develop and optimise cloud-based data solutions within Azure, ensuring high performance, scalability and cost efficiency.
- Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives.
- Automate and monitor data workflows using tools such as Databricks Workflows, Delta Live Tables and Azure Monitor.
- Ensure data quality, integrity and governance through effective controls, security standards and regulatory compliance.
- Collaborate with stakeholders across Pricing, Underwriting, Data Science and Technology to deliver data-driven business solutions.
- Implement data security and governance frameworks, including access controls, data lineage and sensitive data protection.
- Drive continuous improvement by adopting new technologies and best practices across the Azure and Databricks ecosystem.
What you'll need:
- Strong experience building data pipelines using Azure Data Factory, Databricks and Azure Data Lake.
- Advanced SQL and Python (PySpark) skills for data transformation, automation and optimisation.
- Hands-on experience with Delta Lake, Spark, Databricks Workflows and Structured Streaming.
- Knowledge of data warehousing, lakehouse architectures and dimensional modelling.
- Experience delivering scalable, high-quality data solutions to support analytics, reporting and machine learning.
- Familiarity with real-time data processing, APIs and streaming technologies such as Kafka or Azure Event Hubs.
- Experience with CI/CD, Azure DevOps, GitHub Actions and Infrastructure as Code.
- Strong understanding of data governance, security and access controls, including Unity Catalog and Purview.
- Experience monitoring, optimising and troubleshooting cloud-based data platforms.
- Excellent problem-solving, communication and stakeholder management skills.
- Collaborative approach with the ability to work effectively across technical and business teams.
- Passion for innovation, continuous improvement and emerging data technologies.
Desirable
- Experience with Scala.
- Exposure to MLOps, feature stores and machine learning platforms.
Our Benefits
- Hybrid working - 2 days in the office and 3 days working from home
- 25 days annual leave, rising to 27 days over 2 years' service and 30 days after 5 years' service. Plus bank holidays!
- Discretionary annual bonus
- Pension scheme - 5% employee, 6% employer
- Flexible working - we will always consider applications for those who require less than the advertised hours
- Flexi-time
- Healthcare Cash Plan - claim cashback on a variety of everyday healthcare costs
- Electric vehicle - salary sacrifice scheme
- 100's of exclusive retailer discounts
- Professional wellbeing, health & fitness app - Wrkit
- Enhanced parental leave, including time off for IVF appointments
- Religious bank holidays - if you don't celebrate Christmas and Easter, you can use these annual leave days on other occasions throughout the year.
- Life Assurance - 4 times your salary
- 25% Car Insurance Discount
- 20% Travel Insurance Discount
- Cycle to Work Scheme
- Employee Referral Scheme
- Community support day
#J-18808-Ljbffr
Data Engineer in Newcastle upon Tyne employer: Somerset Bridge Group
Somerset Bridge Group is an exceptional employer, offering a dynamic work culture that fosters collaboration and innovation in the heart of Bristol. With a strong focus on employee growth, we provide extensive benefits including hybrid working options, generous annual leave, and a commitment to professional development, ensuring our team members thrive both personally and professionally. Join us to be part of a forward-thinking company that values your contributions and supports your career journey in the insurance sector.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer in Newcastle upon Tyne
✨Tip Number 1
Familiarise yourself with Azure Databricks and its features, as this role heavily relies on it. Consider building a small project or contributing to an open-source one that uses Azure Databricks to showcase your hands-on experience.
✨Tip Number 2
Network with professionals in the data engineering field, especially those who work with Azure technologies. Attend meetups or webinars to connect with potential colleagues and learn about industry trends that could give you an edge.
✨Tip Number 3
Stay updated on the latest developments in data governance and compliance, particularly FCA/PRA regulations. Being knowledgeable about these can set you apart as a candidate who understands the importance of data integrity in the insurance sector.
✨Tip Number 4
Prepare to discuss your problem-solving skills and how you've tackled challenges in previous projects. Be ready to provide specific examples of how you've optimised data pipelines or improved data quality, as this will demonstrate your practical experience.
We think you need these skills to ace Data Engineer in Newcastle upon Tyne
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights relevant experience and skills that align with the Data Engineer role. Focus on your hands-on experience with Azure Data Factory, Databricks, and SQL, as these are crucial for the position.
Craft a Compelling Cover Letter:In your cover letter, express your enthusiasm for the role and the company. Mention specific projects or experiences that demonstrate your ability to design and optimise data pipelines, and how you can contribute to Somerset Bridge Group's goals.
Showcase Relevant Projects:If you've worked on any relevant projects, especially those involving Azure technologies or data engineering, be sure to include them in your application. Describe your role, the technologies used, and the impact of the project.
Highlight Soft Skills:Don't forget to mention your soft skills, such as communication and collaboration. The role requires working closely with various teams, so showcasing your ability to convey technical concepts to non-technical stakeholders will strengthen your application.
How to prepare for a job interview at Somerset Bridge Group
✨Showcase Your Technical Skills
Be prepared to discuss your hands-on experience with Azure Data Factory, Databricks, and SQL. Highlight specific projects where you've built ELT pipelines or optimised data solutions, as this will demonstrate your capability to handle the technical demands of the role.
✨Understand the Business Context
Familiarise yourself with the insurance sector and how data engineering impacts pricing, underwriting, and claims. Being able to articulate how your work can drive smarter decisions and enhance customer insights will set you apart from other candidates.
✨Prepare for Problem-Solving Questions
Expect to face scenario-based questions that assess your problem-solving skills. Think about past challenges you've encountered in data engineering and how you resolved them, particularly in relation to data quality, governance, and performance tuning.
✨Demonstrate Collaboration Skills
Since the role involves working closely with various teams, be ready to discuss your experience collaborating with Data Scientists, Pricing Teams, and IT. Share examples of how you've effectively communicated technical concepts to non-technical stakeholders to ensure alignment on project goals.
