At a Glance
- Tasks: Lead the transformation of complex data pipelines using AWS and PySpark.
- Company: Join a global tech leader driving innovative cloud data solutions.
- Benefits: Competitive daily rate, flexible contract, and collaborative work culture.
- Other info: Opportunity for significant career growth in a dynamic environment.
- Why this job: Shape the future of data engineering and influence multiple teams.
- Qualifications: Expertise in Python, PySpark, and cloud-native architectures required.
The predicted salary is between 70000 - 90000 £ per year.
We're supporting a global, technology‐led organisation undertaking a large‐scale cloud data transformation programme. This is not a traditional data engineering role. The organisation is modernising hundreds of complex data pipelines, establishing reusable engineering patterns and embedding engineering excellence across its data function. As a staff‐level engineer you will combine deep hands‐on technical expertise with organisation‐wide technical influence, helping shape how modern data engineering is delivered across multiple engineering teams. This is an opportunity to work on enterprise‐scale data movement, cloud‐native architectures and AI‐assisted software engineering within a highly collaborative engineering culture.
Responsibilities
- Defining technical standards and engineering patterns for a large‐scale data modernisation programme
- Re‐engineering complex legacy data pipelines into production‐grade PySpark
- Building scalable, reusable data movement frameworks across multiple engineering teams
- Driving best practice around AWS Glue, Apache Spark and Apache Airflow
- Designing high‐quality testing frameworks covering performance, data quality and reliability
- Leveraging agentic AI development tools to improve engineering productivity while maintaining code quality
- Coaching and influencing experienced engineers through technical leadership rather than line management
- Working closely with enterprise architecture and platform teams to improve how data is governed, managed and consumed
Qualifications
- Staff, Principal or Lead Data Engineering roles
- Expertise in Python and PySpark
- Experience with AWS Glue, Apache Spark and Apache Airflow
- Cloud‐native data engineering architectures
- Large‐scale data pipeline modernisation
- Building reusable engineering patterns within enterprise environments
- Data testing, validation and observability
- AI‐assisted software development using modern coding assistants
- Experience working within regulated or highly governed organisations
Contract £750–£900 per day (inclusive) Initial 6‐month contract with significant programme runway Inside IR35 London (3 days per week on‐site)
Staff Data Engineer | London | Con ... employer: Wedo Technology Solutions Ltd.
Wedo Technology Solutions Ltd. is an excellent employer that prioritises employee growth and development within a supportive work culture. Located in Reading, UK, the company offers a competitive salary, car allowance, and commission, alongside a hybrid working environment that fosters strong customer relationships and collaboration. As a Microsoft Partner, Wedo values long-term success and provides unique opportunities for employees to thrive in their careers.
Contact Details:
Wedo Technology Solutions Ltd. Recruitment Team
