Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Join us as a Big Data Engineer to develop innovative data solutions and tackle real-world challenges.
- Company: Allstate is a leader in insurance, committed to protecting families and innovating transportation through data.
- Benefits: Enjoy flexible working options, a generous benefits package, and access to world-class learning platforms.
- Why this job: Be part of a socially responsible team where your work has purpose and your growth is supported.
- Qualifications: 3+ years in Python/Scala, 2+ years building ETL pipelines, and experience with AWS Cloud required.
- Other info: We value diversity and encourage applications from under-represented groups, especially women.
The predicted salary is between 36000 - 60000 £ per year.
At Allstate, great things happen when our people work together to protect families and their belongings from life\’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers\’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Your role in the team
Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer, and more useful for everyone. At the heart of that mission are the people that work here-the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real-world problems and put your talents towards transforming transportation. That\’s because at Arity, we believe work and life shouldn\’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don\’t just want you to see yourself here. We want you to be yourself here. Arity is committed to supporting an inclusive and diverse environment where you can thrive and learn from others.
This role is responsible for executing multiple tracks of work to deliver Big Data solutions enabling advanced data science and analytics. This includes working with the team on new Big Data systems for analyzing data; the coding and development of advanced analytics solutions to make/optimize business decisions and processes; integrating new tools to improve descriptive, predictive, and prescriptive analytics.
This role contributes to the structured and unstructured Big Data / Data Science tools of Arity from traditional to emerging analytics technologies and methods. The role is responsible for assisting in the selection and development of other team members
Key Responsibilities
- Participate in the development of moderately complex and occasionally complex technical solutions using Big Data techniques in data & analytics processes
- Develops innovative solutions within the team
- Participates in the development of moderately complex and occasionally complex prototypes and department applications that integrate Big Data and advanced analytics to make business decisions
- Uses new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems
- Understands the Big Data related problems and requirements to identify the correct technical approach
- Takes coaching from key team members to ensure efforts within owned tracks of work will meet their needs
- Executes moderately complex and occasionally complex functional work tracks for the team
- Partners with Arity Technology teams on Big Data efforts
- Partners closely with team members on Big Data solutions for our data science community and analytic users
- Leverages and uses Big Data best practices / lessons learned to develop technical solutions
Essential Criteria
- All applicants must demonstrate they have a legal right to work in the UK for employment at Arity. Arity is not providing sponsorship for this vacancy.
- A minimum of 3 years\’ experience in Python and/or Scala
- A minimum of 2 years\’ experience with building big data ETL pipelines
- A minimum of 2 years\’ experience in one or more of the following Java, Kotlin, GoLang
- Experience in Test Driven Development (TDD)
- Demonstrated experience managing large data sets
- AWS Cloud knowledge
- Clear understanding of data management, process automation, system monitoring, and maintainability.
Desirable Skills
- GCP services knowledge
- Experience building Data Lakes (preferably integration with Starburst)
Supervisory Responsibilities
• This job does not have supervisory duties.
Job Posting End Date: Friday 4th July [11:59pm]
Why join us?
Allstate NI is proud to be Allstate\’s European Digital Centre of Excellence-recent winners of \’Best Use of Cloud Services\’ at the Belfast Telegraph IT Awards 2024, and recognised for our community and sustainability impact at the 2024 Business in the Community Awards and Gold accreditation for Environmental Responsibility.
We\’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering excellence. Our teams work in cross-functional structures, guided by an outcome-based delivery approach that accelerates speed, agility, and value.
We offer:
• A generous, flexible benefits package including annual leave, healthcare and dental cover, pension, and lifestyle discounts
• Access to world-class learning platforms and award-winning L&D
• Clear career paths, internal mobility, and a strong focus on growth
• A people-first culture with flexible working options
Be part of a high-performing, socially responsible organisation where your work has purpose, and your growth is supported every step of the way.
Statement on Fair Employment and Equal Opportunities
Allstate NI wishes to ensure equal opportunity is given to all job applicants. This company will not discriminate on the grounds of race, gender (including gender reassignment status), sexual orientation, religious belief, political opinion, marital status, age or disability.
We are an equal opportunities employer. We welcome applications from all suitably qualified persons. However, as women are currently under-represented in our workforce, we would particularly welcome applications from women. All appointments will be made on merit.
Applicants should note Allstate NI complete AccessNI background checks on all candidates offered a position.
Posting End Date:
30 June 2025
Create a job alert and receive personalised job recommendations straight to your inbox.
#J-18808-Ljbffr
Big Data Engineer (Hybrid or Remote) employer: Allstate
Contact Detail:
Allstate Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Big Data Engineer (Hybrid or Remote)
✨Tip Number 1
Familiarise yourself with the specific Big Data technologies mentioned in the job description, such as AWS and ETL pipelines. Being able to discuss these tools confidently during your interview will show that you're not only qualified but also genuinely interested in the role.
✨Tip Number 2
Network with current or former employees of Arity or Allstate. Engaging with them on platforms like LinkedIn can provide you with insider knowledge about the company culture and expectations, which can be invaluable during your application process.
✨Tip Number 3
Prepare to showcase your problem-solving skills through real-world examples. Since the role involves tackling complex data challenges, having a few case studies ready to discuss can demonstrate your analytical thinking and creativity.
✨Tip Number 4
Highlight your experience with Test Driven Development (TDD) and any relevant projects you've worked on. This will align well with their emphasis on quality and maintainability in data solutions, making you a more attractive candidate.
We think you need these skills to ace Big Data Engineer (Hybrid or Remote)
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights relevant experience in Python, Scala, and building ETL pipelines. Use specific examples that demonstrate your skills in Big Data technologies and analytics.
Craft a Compelling Cover Letter: In your cover letter, express your passion for data and analytics. Mention how your unique qualities align with Arity's mission to improve transportation and how you can contribute to their innovative solutions.
Showcase Relevant Projects: If you've worked on projects involving Big Data or advanced analytics, include them in your application. Describe your role, the technologies used, and the impact of your work on business decisions.
Highlight Soft Skills: Arity values teamwork and creativity. In your application, mention experiences where you've collaborated effectively with others or demonstrated problem-solving skills in complex situations.
How to prepare for a job interview at Allstate
✨Showcase Your Technical Skills
Be prepared to discuss your experience with Python, Scala, and building ETL pipelines. Highlight specific projects where you applied these skills, as this will demonstrate your technical proficiency and problem-solving abilities.
✨Understand Big Data Concepts
Familiarise yourself with the latest Big Data technologies and methodologies. Be ready to explain how you've used these tools in past roles, particularly in relation to data ingestion, processing, and distribution.
✨Emphasise Collaboration
Since the role involves working closely with team members and other technology teams, be sure to share examples of how you've successfully collaborated on projects. This could include discussing how you’ve taken coaching from others or partnered on complex solutions.
✨Demonstrate a Growth Mindset
Arity values personal growth and learning. Share instances where you've sought out new knowledge or skills, especially in areas like AWS or GCP services. This shows that you're proactive and committed to continuous improvement.
