Manchester | Hybrid, ideally 2 days per week in office
We're working with a truly disruptive FinTech that is continuing to invest heavily in its data and technology capability.
With a growing Data Science function and around 3-5TB of new data being processed each week, they're looking for a Data Engineer to join the team and help build and develop the platform behind it.
This isn't necessarily a traditional Data Engineering profile. They're open to people from Data Engineering, Platform, DevOps or Systems Engineering backgrounds, but hands-on Databricks and web scraping experience are essential.
The role
You'll work within a cross-functional team, contributing to the move towards a Databricks-native environment and helping build reliable, scalable data and platform capabilities.
You'll be working across:
- Databricks, Python, SQL and Spark
- Web scraping and automated data collection
- High-volume data ingestion and transformation
- Production ETL/ELT pipelines
- APIs, SFTP/FTPS and automated data retrieval
- CI/CD, automated testing and deployment
- Platform reliability, monitoring and troubleshooting
- Azure infrastructure, security and governance
- Data Science, ML and increasingly agentic workflows
The focus is production engineering rather than building AI models. You'll be helping create the foundations that allow Data Science and automated workflows to operate effectively.
What we're looking for
Databricks and web scraping are the two big ones.
Alongside these, we're looking for hands-on experience with Python, SQL/Spark and ETL/ELT, an understanding of databases and data warehousing, and some exposure to platform, DevOps or systems engineering principles.
Just as important is mentality. They want someone who is technically curious, excited by what's happening across AI and constantly looking at what's next. Someone who experiments, keeps up with new tools and approaches, and naturally wants to stay ahead of the curve rather than waiting for new technology to become mainstream.
You don't need to be an expert in everything. They're looking for strong foundations, the right mindset and someone who wants to keep developing within a highly technical environment.
A STEM background is beneficial, but not essential.
Nice to have
- Playwright/Selenium or similar web scraping/automation tooling
- Databricks Asset Bundles, Lakeflow Jobs/Pipelines, Unity Catalog, Volumes and/or Lakebase
- Agentic or AI-enabled engineering workflows, LLM integrations or AI coding tools
- Terraform/Bicep
- Scala, PowerShell and YAML
The team
You'll join a highly technical, collaborative team working closely with a growing Data Science function. It's a great environment for someone who wants to deepen their Data Engineering experience while being exposed to some of the newest developments across data and AI.
Ideally you'll spend around two days per week in the Manchester office, but it's an output-driven environment with plenty of autonomy.
Diversity & Inclusion
We welcome applications from people of all backgrounds and experiences. If the role interests you but you don't tick every box, we'd still encourage you to apply. Different experiences, perspectives and routes into technology are valued.
#J-18808-Ljbffr
Data Engineer in Manchester employer: Mirai Talent
As an Azure Data Platform Lead at this large global organisation, you will thrive in a dynamic work culture that prioritises innovation and collaboration. The company offers exceptional employee growth opportunities, including access to cutting-edge technology and professional development programmes, all while being part of a diverse team dedicated to excellence in data governance and architecture. Located in a vibrant area, the organisation also provides competitive benefits that enhance work-life balance, making it an ideal place for those seeking meaningful and rewarding employment.
