At a Glance
- Tasks: Design and build data pipelines for our innovative SaaS platform, transforming terminal data into actionable insights.
- Company: Join All Your BI, a remote-first data agency revolutionising logistics with cutting-edge technology.
- Benefits: Earn €85,000-€99,000, enjoy 25 vacation days, and receive €5,000 for personal growth.
- Other info: Collaborate directly with terminal operations staff and enjoy team trips and outings.
- Why this job: Shape the future of data engineering in a fast-growing company while working remotely across Europe.
- Qualifications: 5+ years of data engineering experience, strong SQL and Python skills, and a passion for architectural ownership.
The predicted salary is between 85000 - 99000 £ per year.
Maybe you call yourself a Senior Data Engineer, a pipeline architect, a "why-is-this-TOS-data-a-mess" specialist… or maybe you just call yourself Sam. Whatever you call yourself, you'll join Terminal.exe, All Your BI's AI-native data platform for container terminal operators, and build the core of it: the pipelines and data model that turn fragmented, hard-to-trust terminal data into something operators run their day on.
What you get
- A salary between €85,000-€99,000 per year inclusive of holiday allowance, based on your experience.
- €5,000 a year for your own growth, with a real say in how you spend it.
- 25 vacation days + the option to buy up to 10 more + local public holidays + the option of a sabbatical up to 4 months.
- Two trips abroad a year with the whole team + occasional drinks and team outings.
- €500 home-office budget and a great laptop.
- A well-earned "Hey, well done Buddy!", so now and then.
- Fully remote, within Europe.
Benefits across the EU: the perks above are AYBI's and go to everyone, everywhere. Statutory benefits (pension, health, social security, leave, sick pay, notice) follow the hire's country via their local contract or EOR.
About us
All Your BI is a remote-first data agency based in Rotterdam. Since 2019 we've grown from a boutique consultancy into an international data team of more than 60 data heroes spread across Europe. We deliver managed BI services for logistics and industrial companies, helping reduce data waste and move businesses forward. We live for the WOW moment, that sparkle in users' eyes when they gain new insights and discover opportunities.
About Terminal.exe
Terminal.exe is All Your BI's SaaS platform for container terminals. It unifies fragmented data, TOS, maintenance, gate, sensors, into one governed model, so every site works from the same numbers instead of rebuilding its own reporting from scratch. The platform is growing fast. You'll help shape the engineering foundations that need to scale next: multi-tenant data architecture, near-real-time pipelines from 24/7 operations, and a standardized data model that works across terminals worldwide.
What the job looks like
You will design and build the pipelines that move data from terminal operating systems (such as Navis N4) into our platform, and the transformation layer that turns raw operational data into curated, documented datasets.
Concretely, you will work on:
- ELT pipelines from on-premises terminal databases into our Azure-based platform, with near-real-time refresh (3-minute microbatch) for operational reporting and daily batch for analytics. Extraction uses watermark-based incremental queries over Kafka (Azure Event Hubs) to PostgreSQL staging.
- A multi-tenant data architecture on Azure PostgreSQL with database-per-tenant isolation and a standardized STG → ODS → DataMart layer structure driven by our internal declarative transformation framework (dewi).
- Our internal connector tooling written in Go, which you will help develop and extend.
- Data quality monitoring: gap detection, freshness alerting, and reconciliation.
- The standardized terminal data model: mapping source data from different TOS versions and configurations onto shared definitions of moves, calls, and equipment events.
You will work directly with terminal operations staff, without intermediate layers.
What you bring
Attitude and experience: curiosity and a genuine appetite for architectural ownership, and 5+ years of data engineering experience, including end-to-end ownership of production data platforms. This is a product under active development, we need you comfortable deciding, not just executing.
Core stack: strong SQL and Python; Go experience is a significant plus (our connectors and consumers are written in Go). Solid experience with SQL Server as a source system and PostgreSQL as a target store.
Pipelines and streaming: experience building and operating ELT pipelines against operational source systems, including watermark/incremental or CDC/replica-based extraction, and with event-driven or streaming architectures, we use Azure Event Hubs with a Kafka-compatible endpoint.
Cloud and observability: cloud data platform experience on Azure, familiarity with AKS, Azure DevOps CI/CD, and GitOps (Argo CD) is a plus, alongside a strong focus on data correctness and instrumentation, we use OpenTelemetry.
Nice to have: knowledge of the container terminal or port logistics industry, direct experience with Navis N4 or another TOS, multi-tenant SaaS data architecture experience, and familiarity with declarative, YAML-driven transformation frameworks. Industry knowledge is a strong plus, not a hard requirement, we'll teach you the terminal domain.
Senior Data Engineer - Terminal.exe in London employer: All Your BI
All Your BI is an exceptional employer that fosters a collaborative and innovative work culture, perfect for those looking to make a significant impact in the field of data engineering. With a focus on employee growth, we offer continuous learning opportunities and the chance to work with cutting-edge technology in a remote setting, allowing for a flexible work-life balance. Join us to be part of a forward-thinking team that values your contributions and supports your professional development.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Data Engineer - Terminal.exe in London
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like All Your BI!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior Data Engineer - Terminal.exe at All Your BI.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like All Your BI.
✨Apply Directly through Our Website
When you find a suitable opening like Senior Data Engineer - Terminal.exe at All Your BI, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Senior Data Engineer - Terminal.exe in London
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at All Your BI, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at All Your BI. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at All Your BI
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at All Your BI!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
