Lead Data Engineer | 6 Month Contract | (Inside IR35) | Hybrid, 2 days pw Edinburgh/Glasgow | Starting ASAP Day Rate: DOE Harvey Nash's Pub Sec client is seeking an experienced AWS Data Engineer to design, develop, and support scalable data warehouse and cloud-based data solutions. The successful candidate will work within an Agile Scrum team, delivering end-to-end data engineering solutions, ETL pipelines, and analytics platforms that support business intelligence and digital applications. Design, build, and maintain cloud-based data warehouse and data lake solutions on AWS. Develop and support ETL/ELT processes for data ingestion, transformation, and integration. Build and optimise data pipelines using Python, SQL, Spark, and AWS services. Develop serverless and event-driven solutions using AWS Lambda, Step Functions, EventBridge, SQS, and SNS. Support and enhance existing data platforms, applications, and integrations. Work closely with business and technical stakeholders to deliver solutions in 2-week Agile sprints. Create and maintain dashboards, reporting, and monitoring solutions using QuickSight, Power BI, Grafana, and ELK. Implement data quality, security, governance, and operational monitoring best practices. Strong experience with AWS data and analytics services including: Strong programming experience in Python and SQL. Experience with Spark (PySpark preferred) and large-scale data processing. Experience developing ETL/ELT pipelines and data warehouse solutions. Experience working in Agile/Scrum delivery environments.
Lead Engineer/Data Engineer in Edinburgh employer: Harvey Nash
Join a dynamic global banking organisation that prioritises innovation and employee development. With a collaborative work culture, comprehensive benefits, and ample opportunities for professional growth, this role as a SWIFT / Payments Project Manager offers a chance to make a significant impact in the financial sector while enjoying a supportive environment in a thriving location.
