At a Glance
- Tasks: Build and maintain scalable data pipelines using Databricks and Apache Spark.
- Company: Join a forward-thinking team in the Retail Insight Data and Engineering sector.
- Benefits: Enjoy a competitive salary, remote work flexibility, and opportunities for professional growth.
- Other info: Dynamic remote or hybrid work environment with excellent career advancement potential.
- Why this job: Make a real impact by shaping engineering standards and optimising data workflows.
- Qualifications: Strong experience in data engineering and familiarity with cloud technologies required.
The predicted salary is between 63000 - 77000 £ per year.
Salary: £65,000
Type: Full time, permanent
Hours: 37.5 per week
Location: Remote or Hybrid UK, with occasional Richmond office attendance (a couple of times per month)
Overview: We are looking for a Senior Data Engineer to join the Retail Insight Data and Engineering team, contributing to the design, development and day to day operation of our Databricks environment. You will build reliable, scalable pipelines and help shape engineering standards, working closely with the Lead Data Engineer and partnering with data science, analytics and product teams.
Key responsibilities:
- Build and maintain scalable data pipelines using Databricks, Apache Spark and Delta Lake
- Develop and optimise batch and streaming workflows for reliability and performance
- Contribute to lakehouse architecture and medallion pattern implementation
- Implement data quality checks, monitoring and observability across pipelines
- Apply platform security, access control and governance standards
- Support code reviews and high engineering quality standards
- Identify cloud cost optimisation opportunities
- Translate business requirements into technical solutions
- Contribute to documentation and continuous improvement
Required experience:
- Strong experience delivering...
Senior Data Engineer employer: FBI &TMT
Join a forward-thinking consultancy that champions innovation and technical excellence in the Energy sector. As a GIS Technical Lead, you'll thrive in a collaborative work culture that prioritises employee growth and development, offering you the chance to lead impactful projects while enjoying a range of benefits tailored to support your professional journey. Located in a vibrant area, this role not only provides meaningful work but also fosters a sense of community and purpose.