At a Glance
- Tasks: Build a data lake on Azure and develop ingestion pipelines using Python.
- Company: Leading client in the financial services sector, specialising in insurance.
- Benefits: Fully remote work with a 3-month contract and potential for extension.
- Other info: Opportunity to work outside IR35 with flexible working arrangements.
- Why this job: Join a dynamic team and shape data architecture in a cutting-edge environment.
- Qualifications: Experience with Azure, Databricks, and Python; ideally in the insurance sector.
The predicted salary is between 60000 - 80000 Β£ per year.
One of our leading clients is looking to recruit a Data Engineer.
Location β fully remote / home based
Duration β 3 months plus possible extension
Outside IR35
Role / Responsibilities:
- Define and build a data lake architecture on Azure (ADLS + Databricks)
- Implement layered data model (bronze / silver / gold) for ingestion, processing, and reporting
- Develop ingestion patterns from API sources (batch and streaming)
- Establish data governance, metadata, and access controls
- Define storage structures, naming conventions, and schema design
- Develop API connectors and ingestion pipelines using Python
- Implement integration services feeding into the Databricks environment
- Build data transformation logic using PySpark / Python (data cleansing, standardisation, validation)
- Configure monitoring, logging, and alerting
- Execute unit and integration testing across pipelines
Experience:
- Azure
- Databricks
- Python
- Financial Services sector experience β Ideally Insurance / General or Life Insurance
Data Engineer β Azure / Databricks / Python / Insurance - remote - 3 month contract in Bolton employer: MYO Talent
As a leading player in the financial services sector, our company offers an exceptional remote working environment that prioritises flexibility and work-life balance. We foster a culture of innovation and collaboration, providing our Data Engineers with ample opportunities for professional growth through challenging projects and access to cutting-edge technologies like Azure and Databricks. Join us to be part of a dynamic team where your contributions are valued and rewarded, all from the comfort of your home.