At a Glance
- Tasks: Lead the design and implementation of enterprise-scale data pipelines and lakehouse architectures.
- Company: Join a forward-thinking company at the forefront of data engineering.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Dynamic role with significant impact on large-scale transformation programmes.
- Why this job: Shape the future of data platforms while mentoring the next generation of engineers.
- Qualifications: 7+ years in data engineering with strong Databricks and Spark experience.
The predicted salary is between 60000 - 75000 £ per year.
Job Role
We are seeking a Senior Databricks Data Engineer to lead delivery of data engineering workstreams within large-scale data platform and migration programmes.
This role combines hands-on technical expertise with consulting leadership, ensuring the successful design, delivery and operation of modern data platforms while working closely with client stakeholders.
You will play a key role in shaping architecture decisions, mentoring engineers and driving delivery across complex engagements.
Key Responsibilities
- Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures
- Provide technical leadership across Databricks, Spark and cloud data platforms
- Drive delivery of data engineering workstreams within Agile programmes
- Engage with client stakeholders to translate business objectives into technical solutions
- Mentor engineers and establish engineering best practices
- Lead architecture and design discussions with architects and platform teams
- Oversee performance optimisation and platform reliability
- Support data migration strategy and execution
- Ensure governance, security and compliance standards are met
- Produce architecture documentation, design artefacts and delivery roadmaps
- Key Requirements
- 7+ years experience in data engineering or data platform development
- Strong experience with Databricks, Spark and distributed data processing
- Experience with Unity Catalog, Delta Lake and streaming architectures
- Advanced Python and Microsoft SQL Server development
- Proven experience leading engineering teams or workstreams
- Strong stakeholder engagement and consulting skills
- Working knowledge of Hadoop
- Experience with test-driven development and CI/CD
- REST APIs and Kafka experience
- Nice to Have
- Experience leading data platform migrations
- Experience managing delivery in large transformation programmes
- Experience delivering projects in regulated environments
- #J-18808-Ljbffr
Senior Data Engineer - Databricks employer: ISx4 Group
Join a forward-thinking company that values innovation and collaboration, where as a Data Engineer, you will have the opportunity to work with cutting-edge technologies like Databricks and Spark in a dynamic cloud environment. Our inclusive work culture fosters continuous learning and professional growth, ensuring you can develop your skills while contributing to impactful data solutions for enterprise clients. Located in a vibrant area, we offer a supportive atmosphere that encourages teamwork and creativity, making it an excellent place for those seeking meaningful and rewarding employment.
