At a Glance
- Tasks: Design and build scalable data platforms using cutting-edge technologies like Apache Spark.
- Company: Join Allstate, a leader in innovation and a great place to work.
- Benefits: Enjoy competitive salary, hybrid working, and extensive professional development opportunities.
- Other info: Be part of a supportive culture focused on growth and community impact.
- Why this job: Make a real impact on data solutions that drive analytics and decision-making.
- Qualifications: 2+ years in Data Engineering with strong skills in Apache Spark and ETL processes.
The predicted salary is between 56700 - 69300 £ per year.
At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties.
And for more than 90 years, our innovative drive has kept us a step ahead of our customers' evolving needs.
From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Your role in the team
Allstate's Data & Analytics Technology organization is seeking a highly skilled and hands-on Senior Data Engineer to design, build, optimize, and support scalable, reliable, and high-performing data platforms and pipelines.
This role is focused on developing enterprise data solutions that enable analytics, reporting, AI/ML, and data-driven decision making across the organization.
The ideal candidate possesses strong expertise in modern data engineering practices, Apache Spark, cloud-based data platforms, and lakehouse architectures.
As a senior individual contributor, the candidate will provide technical leadership, mentor junior engineers, drive engineering best practices, and contribute directly to the design and implementation of enterprise-scale data solutions.
The role requires close collaboration with Analytics Engineers, Data Scientists, Product Managers, Platform Engineers, Security teams, and business stakeholders to deliver trusted, scalable, and analytics-ready data products.
Key responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using
Apache Spark , cloud-native technologies, and modern data platforms.
- Build and optimize ETL/ELT frameworks to ingest, transform, validate, and curate data from diverse enterprise source systems.
- Develop and implement data solutions leveraging
Microsoft Fabric, One Lake, Lakehouse, Data Warehouse, and Semantic Model capabilities.
- Design data models, storage strategies, and data processing architectures that support enterprise analytics and reporting requirements.
- Partner with Analytics Engineers, BI teams, Data Scientists, and business stakeholders to deliver trusted, reusable, and analytics-ready datasets.
- Drive adoption of engineering best practices including code quality, peer reviews, automated testing, CI/CD, and documentation standards.
- Ensure data quality, governance, lineage, metadata management, security, privacy, and compliance requirements are incorporated into data solutions.
- Monitor and optimize performance, scalability, reliability, and cost efficiency of distributed data processing workloads.
- Develop reusable frameworks, libraries, templates, and engineering patterns that improve development productivity and consistency.
- Implement and support CI/CD pipelines, Infrastructure-as-Code principles, and deployment automation for data engineering solutions.
- Troubleshoot complex data integration, performance, and operational issues across platforms and pipelines.
- Collaborate with platform, infrastructure, architecture, and security teams to build resilient, scalable, and secure enterprise data solutions.
- Create and maintain technical documentation, architecture diagrams, operational runbooks, and implementation guides.
- Participate in technical design sessions, architecture reviews, and engineering discussions while providing recommendations and solutions.
- Mentor and guide junior and mid-level data engineers through technical coaching, code reviews, design reviews, and knowledge sharing.
- Evaluate and adopt emerging technologies, engineering practices, and AI-assisted development capabilities to improve delivery velocity and quality.
- Support production operations through monitoring, root cause analysis, incident resolution, and continuous improvement initiatives.
- Contribute to Agile delivery processes including sprint planning, estimation, backlog refinement, and execution of engineering commitments.
- Promote Data Ops practices, automation, observability, and engineering excellence across development teams.
- Serve as a technical subject matter expert for modern data platforms, Spark processing, Microsoft Fabric, and lakehouse architectures.
Essential Skills
- All applicants must demonstrate they have a legal right to work in the UK for employment at Allstate. Allstate is not providing sponsorship for this vacancy.
- A minimum of 2 years of experience in Data Engineering and Big Data technologies.
- Deep expertise in Apache Spark (Py Spark/Spark SQL).
- Experience with Microsoft Fabric, One Lake, Lakehouse Architecture, Data Warehouse, and building Semantic Models.
- Strong SQL and data modeling skills.
- Experience building and optimizing ETL/ELT pipelines.
Desirable Skills
- Strong proficiency in Java and experience building distributed applications and services.
- Experience with Kafka or similar event-streaming platforms.
- Understanding of Data Governance, Data Quality, Security, and Privacy controls.
- Ability to mentor junior engineers and provide technical leadership without direct people management responsibilities.
- Knowledge of streaming and batch data processing patterns.
- Experience with observability solutions including logging, monitoring, tracing, and performance analysis.
- Experience working in cloud-based analytics and data platform environments.
- Experience with CI/CD, Git-based development, testing, and deployment automation.
- Experience working in Agile delivery environments.
- Job Posting End Date: Friday 11th September
- #LI-TR3
Skills
- Software Development
- Shape the Future of Insurance with Cutting-Edge Tech and a People-First Culture
Allstate NI is proud to be Allstate's European Digital Centre of Excellence, a hub for innovation and engineering excellence.
We're recent winners of Best Place to Work in IT (100+ employees) and Best Use of Cloud Services at the Belfast Telegraph IT Awards, and we've been recognised for our community and sustainability impact with Platinum in the Northern Ireland Environmental Benchmarking Survey.
We're a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering excellence.
Our teams work in cross-functional structures, guided by an outcome-based delivery approach that accelerates speed, agility, and value.
We also invest in you.
At Allstate NI, your career growth matters.
You'll have access to our Continuous Learning Hub, designed to support skills development and professional advancement through tailored learning paths, certifications, and mentoring opportunities.
Whether you're deepening technical expertise or exploring leadership roles, we provide the tools and support to help you thrive.
What do you get in return?
- As well as receiving a competitive annual salary, our reward package includes:
- Corporate bonus scheme
- Pension scheme
- Annual performance-related pay reviews
- Life assurance and income protection
- Flexible working options
- Hybrid working
- Private medical and dental insurance
- Access to an employee assistance programme
- Discounted gym membership
- Two paid volunteering days each year
- Cycle to work scheme
Be part of a high-performing, socially responsible organisation where your work has purpose, and your growth is supported every step of the way.
#J-18808-Ljbffr
Software Engineer Senior Consultant II - (Hybrid) employer: Allstate Insurance Company
Allstate NI is an exceptional employer that fosters a collaborative and innovative work culture, where employees are empowered to drive meaningful change in enterprise automation. With a strong focus on professional growth, team members have access to continuous learning opportunities and the chance to work on cutting-edge technology in a hybrid environment, making it an ideal place for those looking to advance their careers while contributing to impactful projects.
Contact Details:
Allstate Insurance Company Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Software Engineer Senior Consultant II - (Hybrid)
✨Join Local Tech Meetups
Get out there and mingle with fellow developers by joining local tech meetups. It’s a fantastic way to meet people who might be working at Allstate Insurance Company or know someone who does. Plus, you can pick up some trendy tech skills and trends while you're at it!
✨Contribute to Open Source Projects
Show off your coding chops by jumping into open-source projects. Not only does this give you practical experience, but it also gets you noticed in the dev community. You'll create a killer portfolio that speaks volumes about your skills to Allstate Insurance Company.
✨Tap into Online Developer Communities
Don’t underestimate the power of online developer communities like GitHub, Stack Overflow, and even Reddit. Participate in discussions, share your projects, and build your visibility. We can often find opportunities through these channels that can lead to a full-time gig at companies like Allstate Insurance Company.
✨Explore Job Boards Specifically for Tech Roles
Keep your eyes peeled on job boards that focus on tech roles. Sites like TechCareers or Stack Overflow Jobs can often have listings for companies like Allstate Insurance Company that might not show up on broader job sites. Make it a habit to check these regularly, and don’t hesitate to apply directly through our website!
We think you need these skills to ace Software Engineer Senior Consultant II - (Hybrid)
Some tips for your application 🫡
Show off your coding skills:When applying for a software engineering role, it's super important to showcase your coding skills. Make sure your CV includes your tech stack, any relevant programming languages you’re comfortable with, and examples of projects you've worked on. If you have a GitHub profile, link it up! We love to see code in action.
Tailor your portfolio:For a full-time role, we’d expect to see some solid examples of your work in your portfolio. Make sure to include at least two or three projects that highlight your problem-solving skills and your ability to work with different technologies. Focus on the projects that are most relevant to the position at Allstate Insurance Company.
Craft a killer cover letter:Your cover letter is your chance to stand out—make it personal! Explain why you want to work at Allstate Insurance Company and how your skills align with the role. Show us your passion for software development. We dig enthusiastic candidates who understand the value of collaboration and continuous learning!
Be clear and concise:When it comes to writing your CV and cover letter, clarity is key. Avoid jargon that could confuse us and stick to simple, direct language. Highlight your achievements with quantifiable results where possible, and keep everything easy to read. A well-organised application goes a long way!
How to prepare for a job interview at Allstate Insurance Company
✨Brush Up on Your Coding Skills
For a full-time software engineering role, it's crucial that we stay sharp with our coding abilities. Expect technical questions that might involve solving problems on the spot or discussing algorithms. Practise on platforms like LeetCode or HackerRank to get comfortable with the types of questions that often come up.
✨Know Your Tools and Frameworks
Make sure we’re well-acquainted with the tools and technologies listed in the job description. Familiarise ourselves with any specific frameworks or programming languages mentioned. If Allstate Insurance Company uses React or Node.js, for instance, be ready to discuss how we’ve used them in previous projects or coursework.
✨Showcase Your Projects
Bring along a portfolio that highlights our best work. This could be code samples, GitHub repositories, or any side projects we’ve built. Make sure we can talk through our thought process for each project, especially the challenges we faced and how we solved them—this shows our problem-solving skills in action.
✨Prepare for Behavioural Questions
While technical skills are key, full-time positions also require cultural fit. Be ready to discuss our previous experiences and how we handle teamwork, conflict, and deadlines. Brush up on the STAR method—Situation, Task, Action, Result—to clearly articulate our past experiences when discussing how we've contributed to a team.
