AWS data engineer

Social network you want to login/join with: Systems Architecture – AWS data engineer Job Description Location: UK – Will require travel to customer site as and when required (Belfast) Job Summary: We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing, and managing data architecture solutions for our customers, with a strong emphasis on Cloud technologies (Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques. Key Responsibilities -Data Ingestion and Extraction: Design and implement efficient data ingestion pipelines to and from databases and file storage services. -Data Transformation and Cleaning: Transform and clean raw data to ensure data quality and consistency. -Data Pipelines: Build, maintain, and optimise data pipelines to automate data flows and enable real-time data processing. -Data Quality Assurance: Monitor data quality and implement measures to ensure data accuracy and completeness. -Database Administration: Manage and maintain databases (e.g., SQL, NoSQL) to ensure optimal performance and security. -Cloud Infrastructure: Deploy and manage data infrastructure on cloud platforms – Primarily AWS -Collaboration: Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions. Key Skills -Strong proficiency in SQL, Python, and Spark. Experience with metadata-driven ETL/ELT. -Experience with AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight -Version Control (Gitlab) and CI/CD -Familiar with security and networking principles, especially in an AWS deployment. -Understanding and experience handling both structured and unstructured data. -AWS focused with working experience and/or relevant certifications such as AWS Certified Data Engineer. -Experience with complex data migrations. -Strong problem-solving and analytical skills. -Excellent communication and collaboration skills. -Understanding of Infrastructure as Code -Understanding of GIS data models #J-18808-Ljbffr