At a Glance
- Tasks: Design and optimise data pipelines using Databricks and AWS technologies.
- Company: Join UK Tote Group, a leader in real-time data solutions.
- Benefits: Competitive salary, bonus scheme, shares option, and generous holiday entitlement.
- Other info: Enjoy a vibrant office culture with social events and opportunities for growth.
- Why this job: Shape the future of data while tackling complex challenges in a collaborative environment.
- Qualifications: Experience with Databricks, Apache Spark, and strong Python and SQL skills.
The predicted salary is between 60750 - 74250 £ per year.
Are you an experienced Data Engineer who is a self-starter by nature, takes ownership of your work and enjoys designing end-to-end solutions that deliver measurable value? UK Tote Group are looking for Data Engineers to join the team where you’ll play a key role in designing, building, and optimising the Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote. Our technology powers real-time insights, supports safer gambling, and helps us deliver trusted, customer-first products across the UK and international markets. Data sits at the heart of how we understand our customers and partners, optimise commercial performance and enhance operational processes so this is an essential role in driving business growth and commercial success.
Reporting into the Data Discipline Lead you will build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Lakeflow Spark Declarative Pipelines (formerly DLT), and Kafka (MSK), ensuring our business teams have fast, trusted data at their fingertips. This is a hands-on engineering role where you’ll collaborate across engineering and BI, to deliver scalable, secure, and governed data solutions under Unity Catalog. Our BI and Data teams are based in our Wigan Office, where you will be expected to work onsite a minimum of 1 day per week with core business hours Monday to Friday 9am to 5pm. This role will also form part of our on-call rota, which will be discussed in further detail at interview.
What You’ll Be Doing:
- Designing, building, and optimising streaming and batch pipelines in Databricks
- Develop robust bronze, silver, and gold delta tables using the Medallion Architecture to serve downstream analytics and APIs
- Implement and manage integrations from AWS MSK (Kafka), S3, and external APIs into the Lakehouse
- Collaborate with reporting engineers to enable high-performance dashboards through Databricks SQL Warehouses
- Monitor, tune, and troubleshoot pipeline performance using Databricks metrics, CloudWatch, and AWS Cost Explorer
What We Are Looking For:
We’re looking for experienced Data Engineers with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark, including Structured Streaming. You should have experience with Kafka (MSK) and real-time data ingestion, as well as a deep understanding of Delta Lake, Declarative Pipelines (DLT) and the Medallion Architecture. A strong AWS background is important, particularly with services such as S3. You’ll need to be proficient in Python and SQL for data engineering and analytics, and comfortable implementing CI/CD pipelines using tools such as GitHub Actions, Azure DevOps. Solid experience with Git, version control, and Spark performance tuning will help you succeed in this role. Most importantly, you’ll bring a collaborative, proactive attitude and an ability to balance platform reliability with the pace of delivery. We are looking for engineers who are analytical, detail-oriented, and motivated by solving complex data challenges. Great communication skills are also essential with the ability to explain data concepts clearly to both technical and non-technical colleagues.
Why Join Us?
In return, you'll have the opportunity to work with a modern cloud-based technology stack, tackle complex real-time data challenges, and play a key role in shaping the future of data at Tote. You'll have the autonomy to shape solutions, influence technical direction and solve complex engineering challenges at scale, while working alongside experienced technology and data professionals in a collaborative, agile environment.
Additionally, our company benefits package includes:
- Competitive Basic Salary
- Discretionary Bonus Scheme
- Company Shares Option Plan
- Contributory pension scheme
- Life insurance (4 x basic salary)
- Simply Health Cash Plan
- Holiday entitlement (33 days inclusive of bank holidays)
- Study Support and opportunity for progression and development
- Confidential 24/7 365 employee assistance helpline
- Agile and collaborative office environment with free parking, fruit, biscuits, and drinks
- Regular social events, charity events and volunteering opportunities
Data Engineer in Wigan employer: UK Tote Group
At the UK Tote Group, we pride ourselves on fostering a supportive and collaborative work culture that prioritises employee wellbeing and professional growth. As a Player Protection Officer, you'll not only contribute to a safer betting environment but also benefit from a competitive salary, generous holiday entitlement, and opportunities for career progression within a friendly team. Our commitment to continuous learning and employee support ensures that you will thrive in your role while making a meaningful impact in the industry.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer in Wigan
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like UK Tote Group!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Data Engineer at UK Tote Group.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like UK Tote Group.
✨Apply Directly through Our Website
When you find a suitable opening like Data Engineer at UK Tote Group, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Data Engineer in Wigan
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at UK Tote Group, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at UK Tote Group. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at UK Tote Group
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at UK Tote Group!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.