At a Glance
- Tasks: Join a dynamic team to build and evolve a cutting-edge data platform.
- Company: Disruptive FinTech investing heavily in data and technology.
- Benefits: Hybrid work, competitive salary, and a focus on professional growth.
- Other info: Diverse and inclusive culture welcoming all backgrounds and experiences.
- Why this job: Make a real impact in a fast-paced environment with innovative technologies.
- Qualifications: Experience with Databricks, Python, SQL, and strong data foundations.
Overview
As a Senior Data Engineer in a disruptive FinTech, you will help build and evolve a Databricks-native data platform that supports large-scale data processing and data science workflows. You will work in a cross-functional team to deliver reliable, scalable ingestion, transformation, and platform capabilities, enabling data science and automated workflows. The role focuses on production engineering, platform reliability, and governance within Azure, with opportunities to shape the data foundation for ML and agentic processes. You’ll operate in an output-driven, collaborative environment with autonomy and continuous learning.
Responsibilities
- Develop and evolve Databricks-based data pipelines and platform capabilities
- Handle high-volume data ingestion and transformation across the stack
- Build production ETL/ELT pipelines
- Implement APIs, SFTP/FTPS data retrieval
- Contribute to CI/CD, automated testing and deployment processes
- Ensure platform reliability, monitoring and troubleshooting
- Manage Azure infrastructure, security and governance
- Support Data Science, ML, and agentic workflows
- Work within a cross-functional team to move toward a Databricks-native environment
Key requirements
- Databricks experience (essential)
- strong Python, SQL/Spark and ETL/ELT能力
- good knowledge of databases and data warehousing, incl. dimensional/Kimball
- understanding of platform, DevOps and systems engineering
- genuine technical curiosity
- STEM background beneficial but not essential
- collaboration
- curiosity
- autonomy
- Databricks
- Python
- SQL
Senior Data Engineer in Manchester employer: Mirai Tech Recruitment
Join a mission-driven organisation in London or Manchester as the Head of Data Science, where your work will directly impact the lives of the people you serve. With a strong focus on employee growth and a collaborative culture, you'll lead a multidisciplinary team to harness data for meaningful advocacy, all while enjoying a competitive salary, generous leave, and hybrid working options. This is an exceptional opportunity to contribute to a public sector initiative that values diversity and inclusivity, making it a truly rewarding place to work.
