At a Glance
- Tasks: Lead and innovate in data engineering, shaping our data platform and mentoring a talented team.
- Company: Join Places for People, the UK's leading social enterprise focused on community and inclusivity.
- Benefits: Enjoy competitive salary, generous leave, healthcare cashback, and flexible working options.
- Other info: Be part of a dynamic team with excellent career growth opportunities and a supportive culture.
- Why this job: Make a real impact on our cutting-edge Data Mesh platform and drive innovation.
- Qualifications: Proven experience in data engineering, strong SQL and Python skills, and leadership abilities.
The predicted salary is between 44000 - 84000 £ per year.
Salary: £44,000 - 84,000 per year
Requirements
- Proven track record in Data Engineering, ideally in a Lead or Principal Engineer role.
- Experience working with cloud data platforms, particularly Google Cloud Platform.
- Strong understanding of Data Mesh principles; direct experience is beneficial.
- Technical mentoring and coaching skills.
- Extensive experience with Data Lake and Data Warehouse solutions.
- Strong proficiency in SQL and Python.
- In-depth knowledge of query optimisation techniques and tuning complex queries.
- Strong understanding of data governance, including data dictionaries, MDM, lineage, data legislation, and PII handling.
- Excellent communication skills and ability to work collaboratively with cross-functional teams.
- Experience working in Agile, Scrum, and SDLC environments.
- Hands-on experience with GCP tools such as BigQuery, DataFlow, Data Fusion, DataStream, Cloud Functions, DataProc, and Airflow/Composer.
- Strong understanding of distributed systems, cloud platforms, and modern data stacks.
- Experience leading complex data solutions through design, build, and deployment.
- Experience driving the implementation and adoption of CI/CD.
- Self-motivated, with strong leadership qualities and the ability to drive innovation.
- Ability to formulate plans to deliver a target state and work closely with managers and engineers to deliver that vision.
Responsibilities
- Provide technical leadership across product domains.
- Define architecture and design for our data platform and data mesh.
- Mentor and build the capability of our data engineering team.
- Enable cross-domain interoperability.
- Support governance and compliance enablement.
- Contribute innovation and strategic influence.
- Ensure our data processes on the platform are robust, performant, and compliant.
- Oversee data ingestion, data quality and integrity, transformation, security, encryption, batch management, monitoring, alerting, and cost control.
- Help design and build our Data Mesh, including data modelling and processing from raw through semantic layers.
- Identify opportunities for automation and process improvement.
- Coach and mentor data engineers.
- Set coding standards and best practices.
- Implement and document data integrity and quality checks.
- Optimise queries.
- Facilitate data engineering collaboration across the team.
- Work closely with our Principal Data Platform Engineer and Data Domain Architect to ensure our platform and pipeline design is optimised and reliable.
- Document our approach and explain solutions to both engineers and non-technical business users.
- Participate in the full development lifecycle of data products.
- Direct the work of other data engineers in the design, build, and deployment of complex data solutions.
Technologies
- Airflow
- Architect
- BigQuery
- CI/CD
- Cloud Composer
- Data Warehouse
- GCP Support
- Python
- SQL
- Security
- DDD Flow
We are Places for People, the UK's leading social enterprise, and we hire people, not numbers. We are committed to building inclusive, thriving communities for our customers and employees, and we value people who do the right thing, are enthusiastic, motivated to grow, believe in community spirit, are respectful, and enjoy their work. Our Data and Platform Engineering team forms the foundation of our Data Office function, designing, building, and maintaining our data platform as we continue our transition from on-premise to Google Cloud and develop a leading-edge Data Mesh platform. This is an exciting time to join a growing business function where you can make your mark on the architecture of our platform and the development of our data engineering capability. We offer a competitive salary with yearly reviews, pension matched up to 7%, 35 days annual leave with buy/sell options, healthcare cashback up to £500 per year, a 2% bonus scheme, training and development, and a range of discounts and perks. We also support flexible working options and a supportive, accessible recruitment process, including reasonable adjustments and guaranteed interviews for eligible candidates.
Principal Data Engineer employer: Sivara GmbH
At Places for People, we pride ourselves on being a leading social enterprise that values our employees as individuals, not just numbers. Our inclusive work culture fosters collaboration and innovation, providing ample opportunities for professional growth and development within our Data and Platform Engineering team. With competitive salaries, generous benefits, and a commitment to flexible working arrangements, we empower our employees to thrive while making a meaningful impact in the communities we serve.
