SKIT is currently looking for an experienced Data Engineer to join an exciting UK-based project. We are seeking a strong Data Engineer with hands-on expertise across Informatica, ETL, AWS Cloud, PySpark, Python, SQL and Data Modelling using Erwin.
Role Overview
The successful candidate will be responsible for designing, developing and maintaining scalable data pipelines and data-processing solutions across cloud and enterprise environments.
The role requires strong technical expertise in Informatica, ETL/ELT, AWS, AWS EMR, PySpark, Python, SQL and Erwin Data Modeler, alongside experience in data analysis, mapping and design.
Key Responsibilities
- Design, develop and maintain scalable ETL/ELT pipelines using Informatica.
- Extract, transform and load data from multiple source systems.
- Monitor and troubleshoot ETL workflows and resolve data-processing issues.
- Maintain high standards of data quality, accuracy and reliability.
- Build and maintain cloud-based data pipelines within AWS environments.
- Work with AWS EMR and distributed data-processing technologies.
- Develop scalable cloud data-processing solutions.
- Optimise data workloads for performance and scalability.
PySpark, Python & SQL
- Develop data-processing and transformation jobs using PySpark and Python.
- Write and optimise complex SQL queries.
- Perform large-scale data manipulation, transformation and validation.
- Troubleshoot and optimise data-processing workflows.
- Create and maintain conceptual, logical and physical data models using Erwin Data Modeler.
- Define data structures, relationships and mappings.
- Support database and enterprise data-modelling activities.
- Maintain accurate data models and technical documentation.
Data Analysis, Mapping & Design
- Analyse source and target data requirements.
- Create detailed source-to-target mappings and transformation rules.
- Support data architecture and integration requirements.
- Ensure consistency and quality across data models and pipelines.
#J-18808-Ljbffr
URGENT HIRING – DATA ENGINEER | UK employer: SK IT SOLUTIONS LTD
At SKIT, we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to thrive. As a Business Analyst in the UK, you will benefit from a supportive environment that encourages professional growth through continuous learning opportunities and engagement with diverse teams. Our commitment to Agile methodologies ensures that you will be at the forefront of impactful projects, making a meaningful difference in the business landscape.
