Data Engineer – 12 Month Fixed-Term Contract in Edinburgh

Division: Data, Technology & Innovation
Department: Digital Intelligence Solutions

• Salary: National (Edinburgh and Leeds) ranging from £52,400 to £71,200 and London from £57,700 to £78,300 (salary offered will be based on skills and experience)
• This role is graded as: Senior Associate – Regulatory
• Your recruitment contact is Sonika via Applications must be submitted through our online portal. Applications sent via social media or email will not be accepted.

About The FCA And Team
We regulate financial services firms in the UK, to keep financial markets fair, thriving and effective. By joining us, you\’ll play a key part in protecting consumers, driving economic growth and shaping the future of UK finance services.

The Data, Technology and Innovation (DTI) division enables the FCA to be a digital-first, data-led smart regulator by delivering a secure, agile and cost-effective technology and data ecosystem that drives better decisions, transparency and operational efficiency. Sitting within DTI, the Digital Intelligence Solutions team deliver a Digital Unified Intelligence Environment to surface insights for action through tools, dashboards and bespoke analysis.

Role Responsibilities

• Provide hands-on technical leadership, guiding the team to build and support solutions that are robust, scalable and fit for purpose within an AWS Cloud environment
• Advise on technical design and architecture for data platforms, ensuring solutions meet business needs and adhere to FCA engineering standards
• Review and assure quality of deliverables from internal and external teams, embedding best practices like CI/CD, automated testing (Test-Driven Development/ Behaviour-Driven Development) and code quality standards
• Identify opportunities for product enhancements and quick wins, influencing design proposals that deliver measurable business benefits
• Opportunity to work closely with senior professionals, diverse stakeholders and third-party suppliers to deliver technology change that makes FCA a data-focus, tech-enabled regulator
• Foster a culture of agility and continuous improvement, enabling faster time-to-market, predictable releases and optimised delivery through modern engineering practices

Minimum
Skills required

• Experience in building and delivering robust data platforms and systems within Agile and DevOps environments, leveraging AWS Cloud to create scalable, secure and high-performing solutions
• Prior experience applying modern engineering practices such as CI/CD, Lean Architecture, automated testing (Test-Driven Development/ Behaviour-Driven Development), branching strategies and continuous monitoring to ensure quality and efficiency
• Experience working with technologies like Cloudera, Talend ETL, Python and PySpark, while collaborating with stakeholders and third-party suppliers to deliver impactful, end-to-end data solutions

Essential

• Proven expertise in designing and optimising data pipelines and ETL workflows that transform data into actionable insights
• Deep knowledge of big data technologies and strong understanding of data governance, security and compliance principles
• Ability to collaborate seamlessly with cross-functional teams and manage complex integrations across diverse environments
• Passion for innovation and continuous improvement with a focus on enhancing performance and reliability in data engineering

Benefits

• 25 days annual leave plus