Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Join our team to develop innovative Big Data solutions and tackle real-world transportation challenges.
- Company: Arity, part of Allstate, is revolutionising transportation through data and analytics.
- Benefits: Enjoy flexible working options, a generous benefits package, and access to world-class learning platforms.
- Why this job: Be part of a socially responsible organisation where your work has purpose and supports your growth.
- Qualifications: 3+ years in Python/Scala and 2+ years building big data ETL pipelines required.
- Other info: We value diversity and encourage applications from under-represented groups.
The predicted salary is between 42000 - 84000 £ per year.
4 days ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Your role in the team
Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer, and more useful for everyone. At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real-world problems and put your talents towards transforming transportation. That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here. Arity is committed to supporting an inclusive and diverse environment where you can thrive and learn from others.
This role is responsible for executing multiple tracks of work to deliver Big Data solutions enabling advanced data science and analytics. This includes working with the team on new Big Data systems for analyzing data; the coding and development of advanced analytics solutions to make/optimize business decisions and processes; integrating new tools to improve descriptive, predictive, and prescriptive analytics.
This role contributes to the structured and unstructured Big Data / Data Science tools of Arity from traditional to emerging analytics technologies and methods. The role is responsible for assisting in the selection and development of other team members
Key Responsibilities
- Participate in the development of moderately complex and occasionally complex technical solutions using Big Data techniques in data & analytics processes
- Develops innovative solutions within the team
- Participates in the development of moderately complex and occasionally complex prototypes and department applications that integrate Big Data and advanced analytics to make business decisions
- Uses new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems
- Understands the Big Data related problems and requirements to identify the correct technical approach
- Takes coaching from key team members to ensure efforts within owned tracks of work will meet their needs
- Executes moderately complex and occasionally complex functional work tracks for the team
- Partners with Arity Technology teams on Big Data efforts
- Partners closely with team members on Big Data solutions for our data science community and analytic users
- Leverages and uses Big Data best practices / lessons learned to develop technical solutions
Essential Criteria
- All applicants must demonstrate they have a legal right to work in the UK for employment at Arity. Arity is not providing sponsorship for this vacancy.
- A minimum of 3 years’ experience in Python and/or Scala
- A minimum of 2 years’ experience with building big data ETL pipelines
- A minimum of 2 years’ experience in one or more of the following Java, Kotlin, GoLang
- Experience in Test Driven Development (TDD)
- Demonstrated experience managing large data sets
- AWS Cloud knowledge
- Clear understanding of data management, process automation, system monitoring, and maintainability.
Desirable Skills
- GCP services knowledge
- Experience building Data Lakes (preferably integration with Starburst)
Supervisory Responsibilities
- This job does not have supervisory duties.
Job Posting End Date: Friday 4th July [11:59pm]
Why join us?
Allstate NI is proud to be Allstate’s European Digital Centre of Excellence—recent winners of ‘Best Use of Cloud Services’ at the Belfast Telegraph IT Awards 2024, and recognised for our community and sustainability impact at the 2024 Business in the Community Awards and Gold accreditation for Environmental Responsibility.
We’re a product-driven, cloud-first organisation delivering real outcomes through modern technology, a digital product-centric talent model, and a culture rooted in engineering excellence. Our teams work in cross-functional structures, guided by an outcome-based delivery approach that accelerates speed, agility, and value.
We offer:
- A generous, flexible benefits package including annual leave, healthcare and dental cover, pension, and lifestyle discounts
- Access to world-class learning platforms and award-winning L&D
- Clear career paths, internal mobility, and a strong focus on growth
- A people-first culture with flexible working options
Be part of a high-performing, socially responsible organisation where your work has purpose, and your growth is supported every step of the way.
Statement on Fair Employment and Equal Opportunities
Allstate NI wishes to ensure equal opportunity is given to all job applicants. This company will not discriminate on the grounds of race, gender (including gender reassignment status), sexual orientation, religious belief, political opinion, marital status, age or disability.
We are an equal opportunities employer. We welcome applications from all suitably qualified persons. However, as women are currently under-represented in our workforce, we would particularly welcome applications from women. All appointments will be made on merit.
Applicants should note Allstate NI complete AccessNI background checks on all candidates offered a position.
Posting End Date:
30 June 2025
Seniority level
-
Seniority level
Mid-Senior level
Employment type
-
Employment type
Full-time
Job function
-
Job function
Engineering and Information Technology
-
Industries
Insurance and Financial Services
Referrals increase your chances of interviewing at Arity by 2x
Get notified about new Big Data Developer jobs in United Kingdom.
London, England, United Kingdom 2 months ago
Bristol, England, United Kingdom 2 months ago
Manchester, England, United Kingdom 2 months ago
London, England, United Kingdom 6 days ago
London, England, United Kingdom 2 months ago
City Of Westminster, England, United Kingdom 1 week ago
London, England, United Kingdom 4 months ago
London, England, United Kingdom 2 weeks ago
London, England, United Kingdom 1 month ago
City Of Bristol, England, United Kingdom £50,000.00-£70,000.00 3 weeks ago
London, England, United Kingdom 4 weeks ago
Great Work, England, United Kingdom 3 days ago
London, England, United Kingdom 2 weeks ago
Northern Ireland, United Kingdom £80,000.00-£120,000.00 2 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Big Data Engineer (Hybrid or Remote) - Arity employer: Arity
Contact Detail:
Arity Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Big Data Engineer (Hybrid or Remote) - Arity
✨Tip Number 1
Familiarise yourself with the specific Big Data technologies mentioned in the job description, such as AWS and ETL pipelines. Having hands-on experience or projects that showcase your skills in these areas can set you apart from other candidates.
✨Tip Number 2
Engage with the Arity community on platforms like LinkedIn or relevant tech forums. Networking with current employees can provide insights into the company culture and expectations, which can be invaluable during interviews.
✨Tip Number 3
Prepare to discuss your experience with Python, Scala, and any other programming languages listed in the job description. Be ready to share specific examples of how you've used these languages to solve complex problems or improve processes.
✨Tip Number 4
Showcase your understanding of data management and process automation by preparing a few case studies or examples from your past work. This will demonstrate your ability to apply theoretical knowledge to real-world scenarios, which is crucial for this role.
We think you need these skills to ace Big Data Engineer (Hybrid or Remote) - Arity
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Python, Scala, and building big data ETL pipelines. Use specific examples that demonstrate your skills in these areas, as well as any relevant projects you've worked on.
Craft a Compelling Cover Letter: In your cover letter, express your passion for data analytics and how your background aligns with Arity's mission to improve transportation. Mention your experience with AWS Cloud and any knowledge of GCP services, as these are desirable skills for the role.
Showcase Problem-Solving Skills: Provide examples in your application that illustrate your ability to tackle complex problems using Big Data techniques. Highlight any innovative solutions you've developed or contributed to in previous roles.
Highlight Team Collaboration: Since the role involves working closely with team members, emphasise your experience in collaborative environments. Discuss how you’ve partnered with others on projects and how you value diverse perspectives in problem-solving.
How to prepare for a job interview at Arity
✨Showcase Your Technical Skills
Make sure to highlight your experience with Python, Scala, and any other relevant programming languages. Be prepared to discuss specific projects where you've built ETL pipelines or worked with large data sets, as this will demonstrate your hands-on expertise.
✨Understand the Company’s Mission
Familiarise yourself with Arity's focus on improving transportation through data analytics. Being able to articulate how your skills align with their mission will show that you are genuinely interested in the role and the company.
✨Prepare for Problem-Solving Questions
Expect to face questions that assess your problem-solving abilities, especially related to Big Data challenges. Practice explaining your thought process and the technical approaches you would take to tackle complex data issues.
✨Emphasise Collaboration and Teamwork
Since the role involves working closely with team members and other technology teams, be ready to discuss your experiences in collaborative environments. Highlight instances where you contributed to team success or learned from others, showcasing your ability to thrive in a team-oriented culture.
