Senior Data Engineer - Python / PySpark / SQL

Senior Data Engineer - Python / PySpark / SQL

Full-Time 63000 - 77000 Β£ / year (est.) Home office (partial)
Harvey Nash Group

At a Glance

  • Tasks: Join a dynamic team to innovate and prevent fraud using cutting-edge technology.
  • Company: Thriving Financial Services business with a digital-first approach.
  • Benefits: Hybrid work model, competitive salary, and opportunities for professional growth.
  • Other info: Collaborative environment with a focus on continuous learning and improvement.
  • Why this job: Make a real impact on protecting clients across the UK & Europe.
  • Qualifications: Experience in data engineering with strong Python and SQL skills.

The predicted salary is between 63000 - 77000 Β£ per year.

Fantastic opportunity to join a thriving Financial Services business. This is a hybrid role, and can be based out of either the London or Manchester office.

As a digital-first company, our Enterprise Security & Fraud (ES&F) team aims to innovate using cutting edge technology to prevent fraud and financial crime on our investment platform.

Join an established cybersecurity-focused development team and be on the cutting edge of implementing a suite of tools to protect hundreds of thousands of clients across the UK & Europe.

In this role you will

  • Be creative with solutions for business needs, it's important that we consider our options outside of what is already being done.

We want to build resilient, future-proof novel solutions.

  • Aid with the design and implement of pipelines for real-time analysis and critical decision making for operational systems.
  • Build ELT pipelines, from source to presentation of data to our internal customers.
  • Write high quality, testable and readable code, assist with code reviews, provide solution design input, build automated tests, create documentation, and other tasks throughout the development lifecycle.
  • Collaborate closely with junior and senior developers, scrum master, and product owner to ensure the data is enabling our client experience.
  • Identify and help implement continuous improvement of technical standards, methodologies, technologies, and processes.
  • Own the deployment and operations of the system across environments from development, test, and through to production.
  • Participate in agile meetings aligned to the scrum framework: sprint planning, daily scrums, sprint review, sprint retrospective.

Qualifications we're looking for

A bachelor's degree in computer science, STEM or related discipline is a plus, but not strictly required.

Experience as a data engineer.

Strong experience with Python and SQL is required as well as a solid understanding of working in a cloud-based environment (AWS is preferred).

Proficient using transformation tools such as Py Spark/Pandas.

Knowledge and practice of graph databases is preferred but not required.

Key responsibilities/ Skills and experience

Familiarity using data quality frameworks, ie. Great Expectations.

Experience building cloud infrastructure using Ia C (Cloud Formation/Terraform).

Demonstrable understanding of industry standards and best practices as it relates to development methodology such as testing, code quality and consistency.

Great communication skills: the ability to bridge the gap between the technical and non-technical across various communication channels.

An understanding of agile software development methodology, with scrum framework experience preferred.

A desire to continuously learn and develop yourself in both technical and non-technical skillsets.

#J-18808-Ljbffr

Senior Data Engineer - Python / PySpark / SQL employer: Harvey Nash Group

Join a leading Financial Services firm in London that prioritises innovation and security, offering a dynamic work culture where your expertise in information security and IT risk management will be valued. With a strong commitment to employee development, you will have access to continuous learning opportunities and the chance to lead high-performing teams in a collaborative environment. Enjoy competitive benefits and the unique advantage of working in one of the world's financial capitals, where your contributions will make a significant impact.

Harvey Nash Group

Contact Details:

Harvey Nash Group Recruitment Team

We think you need these skills to ace Senior Data Engineer - Python / PySpark / SQL

Python
SQL
PySpark
Data Engineering
Cloud-based Environment (AWS)
Data Quality Frameworks (Great Expectations)
Infrastructure as Code (IaC - CloudFormation/Terraform)