Lead Data Engineer – Snowflake, ELT with SQL, Python.
Hybrid working – 1 day per week in central London.
£90-110k DoE
This small, world-class, healthcare scale-up is seeking a topflight Lead Data Engineer to take ownership of its data engineering team, data pipelines and warehouses. Initially the role will be highly technically hands-on architecting, developing, scaling and monitoring complex data pipelines.
This is a key role within the company, mixing technical – developing ETL pipelines and warehouses based around Snowflake – and team leadership. The role will suit a high-energy, pro-active, Data Engineer with expertise gained in fast moving, agile, start-up/scale-up environments.
The company’s mobile, web and data products are live in 12 countries and 8 languages, spanning 3 AWS regions. Their business is growing very strongly.
Requirements:
- Successful academic background in your specialist discipline
- 8+ years' experience in architecting, developing, scaling and monitoring complex data pipelines
- Expert in cloud data platforms e.g. Snowflake, Databricks, BigQuery, Redshift
- Expert in SQL and Python
- Strong understanding of data development best practices
- Strong understanding of design patterns and architectural best practices
- Ability to see the big picture and break it down into manageable chunks
- Experience of mentoring other data engineers and analysts
- Humility and desire to learn from anyone
Responsibilities:
- Owner and lead developer of the company data pipelines and warehouses, based around Snowflake
- Completing the process to move legacy ETL pipelines from Python, SQL, PostgreSQL, Airflow to Snowflake ELT
- Owning data quality, availability and security
- Proactively analysing and improving the quality of data products – including performance, scalability, maintainability, test coverage and documentation
- Striving to implement best practices for data development, establishing and documenting standards across UK and US data teams
- Working with internal and external teams around raw data ingestion (e.g. from EMRs)
- Leading on all hiring into the data team
- Mentoring other Data Engineers
- Leading technical discussions to the right decisions (democracy of ideas)
- Reporting to the Head of Engineering
Benefits include:
- Private healthcare
- Annual training budget
- Flexible hybrid working and home-working set-up allowance
Contact Detail:
Richard Wheeler Associates Recruiting Team