We are seeking a detail-oriented and capable Data Migration Engineer to join our Data & AI practice. The successful candidate will bring solid experience in data migration, ETL/ELT pipeline development, and cloud-based data platforms, with a focus on AWS Data Lakehouse environments. This role is key to supporting the design, build, and validation of data migration pipelines, enabling the successful transition of data from legacy systems to modern cloud platforms. You will contribute to ensuring data quality, integrity, and performance, particularly through structured testing and validation activities. You will work closely with architects, senior engineers, and analysts to deliver scalable and reliable migration solutions, using technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML configurations. You should be comfortable working in a collaborative, delivery-focused environment and have a strong interest in data migration, cloud technologies, and modern data engineering practices. Support delivery within data migration programmes, contributing to key workstreamsCollaborate with architects, engineers, and stakeholders to implement migration solutionsAssist in planning and executing data migration tasks and deliverables Data Migration Engineering Build and maintain data migration pipelines from legacy data warehouses to AWS-based platformsDevelop ETL/ELT pipelines using: AWS GluePython / PySparkSQLYAML configurationsSupport execution of bulk data migrations and incremental/delta loadsAssist with pipeline repointing and migration to cloud environments Data Pipeline Testing & Validation (Core Focus) Test ETL/ELT data pipelines on AWS services, including AWS Glue and Apache IcebergSupport validation of data pipeline migrations to AWS Data Lakehouse architecturesTest pipelines using: Python/PySpark transformationsSQL-based validation logicYAML-driven configurationsExecute and validate: Initial bulk data loadsIncremental/delta data processingWrite and run SQL queries to validate: Data completenessData accuracyTransformation outputsSupport development of test scripts and validation checks AWS Data Platforms & Lakehouse Work with AWS services including: AWS GlueS3-based data lakesSupport implementation of Data Lakehouse architectures, including Apache IcebergContribute to improving pipeline performance and reliability Data Transformation & Support Apply transformation logic based on defined data mapping rulesSupport preparation of data for target-state modelsAssist in ensuring consistency between source and target datasets Quality, Governance & Security Support maintenance of data quality and integrity during migrationFollow secure data handling practicesAssist with compliance requirements, including: GDPRPublic sector data standards (where applicable)Contribute to testing, validation, and audit activities Experience in data engineering or data migration deliveryStrong focus on testing, validation, and data quality assuranceAbility to work across data pipelines and transformation workflowsGood analytical and problem-solving skillsEffective communication and teamwork skillsWillingness to learn and develop in data migration and cloud technologies AWS cloud services, especially AWS GluePython / PySparkSQL querying and validationYAML configuration (desirable)Experience testing or supporting: Data lake / Lakehouse concepts (e.g., ETL vs ELT approachesCloud-based data architecturesExposure to version control and CI/CD tools desirable We're a business with a global reach that empowers local teams, and we undertake hugely exciting work that is genuinely changing the world. Our advanced portfolio of consulting, applications, business process, cloud, and infrastructure services will allow you to achieve great things by working with brilliant colleagues, and clients, on exciting projects. We are also proud to share that we have a range of Inclusion Networks such as: the Women's Business Network, Cultural and Ethnicity Network, LGBTQ+ & Allies Network, Neurodiversity Network and the Parent Network. For more information on Diversity, Equity and Inclusion please click here: Creating Inclusion Together at NTT DATA UK | NTT DATA We offer a range of tailored benefits that support your physical, emotional, and financial wellbeing. Our Learning and Development team ensure that there are continuous growth and development opportunities for our people. We also offer the opportunity to have flexible work options. You can find more information about NTT DATA UK & Ireland here: We believe in the fair treatment of all our employees and commit to promoting equity and diversity in our employment practices. We are also a proud Disability Confident Committed Employer - we are committed to creating a diverse and inclusive workforce. We actively collaborate with individuals who have disabilities and long-term health conditions which have an effect on their ability to do normal daily activities, ensuring that barriers are eliminated when it comes to employment opportunities. In line with our commitment, we guarantee an interview to applicants who declare to us, during the application process, that they have a disability and meet the minimum requirements for the role. Join us in building a truly diverse and empowered team.
Data Engineer - SQL, C#, Python in London employer: NTT
At NTT DATA, we pride ourselves on being an exceptional employer that champions diversity and inclusion while fostering a culture of continuous growth and innovation. As a Databricks Solution Architect, you will have the opportunity to work with cutting-edge technologies in a collaborative environment, driving impactful data solutions for our clients. With a commitment to employee development and a focus on meaningful work, NTT DATA is the ideal place for professionals looking to advance their careers in a dynamic and supportive setting.
