At a Glance
- Tasks: Design and build data migration pipelines for seamless data transitions to AWS Data Lakehouse.
- Company: Join a forward-thinking tech company focused on innovation and collaboration.
- Benefits: Flexible work options, continuous learning opportunities, and a commitment to diversity.
- Other info: Mentorship opportunities and a dynamic team environment await you.
- Why this job: Make a real impact in data migration while working with cutting-edge cloud technologies.
- Qualifications: Experience in data engineering, cloud environments, and strong problem-solving skills.
The predicted salary is between 70000 - 90000 £ per year.
A senior practitioner responsible for designing, building, and validating end-to-end data migration pipelines, enabling the seamless transition of data from legacy data warehouses to modern AWS-based Data Lakehouse architectures.
Responsibilities
- Work as a senior engineer within data migration programmes, supporting delivery across complex transformation initiatives.
- Collaborate with architects and stakeholders to implement migration strategies and technical solutions.
- Contribute to project planning, estimation, and execution of migration deliverables.
- Design, build, and optimise data migration pipelines from legacy data warehouses to AWS-based Data Lakehouse platforms.
- Develop and maintain ETL/ELT pipelines using:
- AWS Glue
- Python / PySpark
- SQL
- YAML-driven configurations
- Implement bulk data migration processes followed by incremental/delta loads.
- Support pipeline repointing and replatforming to target cloud architectures.
- Test end-to-end ETL data solutions running on AWS services, including AWS Glue and Apache Iceberg.
- Validate data feed pipeline migrations transitioning to new AWS Data Lakehouse architectures.
- Test pipelines underpinned by:
- AI ETL accelerators
- Python/PySpark transformations
- SQL-based logic
- YAML configuration-driven orchestration
- Execute and validate:
- Initial bulk data loads
- Subsequent incremental/delta migrations
- Develop and run SQL-based validation and reconciliation queries to ensure:
- Data completeness
- Data accuracy
- Transformation correctness
- Support creation of automated testing and validation frameworks.
- Work hands-on with AWS cloud services, including:
- AWS Glue
- S3-based data lakes
- Support implementation of Data Lakehouse architectures, including Apache Iceberg.
- Optimise data pipelines for performance, scalability, and reliability in cloud environments.
- Apply data transformation logic aligned to migration mapping rules.
- Support data modelling activities required for target-state schemas.
- Ensure consistency between source and target systems during migration.
- Collaborate with:
- Solution Architects
- Data Engineers
- Data Migration Architects
- Analysts and QA teams
- Promote engineering best practices, reusable components, and automation.
- Contribute to migration accelerators and reusable frameworks.
- Ensure data integrity, quality, and traceability throughout migration processes.
- Follow best practices for secure data handling in regulated environments.
- Support compliance with:
- GDPR
- UK public sector data requirements (where applicable)
- Contribute to audit and validation processes.
Qualifications
- Proven experience in data engineering and data migration delivery, particularly within cloud environments.
- Strong focus on data pipeline testing, validation, and quality assurance.
- Ability to work across the full data lifecycle, with emphasis on migration and transformation.
- Strong analytical, problem-solving, and communication skills.
- Experience working in client-facing and delivery-focused environments.
- Ability to mentor junior engineers and contribute to team delivery.
Technical Expertise
- Strong hands-on experience with:
- AWS cloud services, especially AWS Glue
- Python / PySpark for data transformation
- SQL for querying, validation, and reconciliation
- YAML configuration for pipeline orchestration
- Experience testing and validating:
- End-to-end ETL/ELT pipelines
- Data migration workflows
- Familiarity with:
- Apache Iceberg and Lakehouse architectures
- Distributed processing frameworks (e.g., Apache Spark)
- Data lake environments
- Understanding of:
- ETL vs ELT design patterns
- Migration performance tuning
- Experience with version control and CI/CD tools desirable.
Benefits
- Flexibility in work options and opportunities for continuous learning and professional development.
Equal Employment Opportunity
We are an equal opportunities employer. We believe in the fair treatment of all employees and are committed to promoting equity and diversity in our employment practices. We are also a proud Disability Confident Committed Employer, ensuring barriers are eliminated for people with long-term health conditions. In line with our commitment, we guarantee an interview to applicants who declare to us during the application process that they have a disability and meet the minimum requirements for the role.
Lead Data Migration Engineer employer: NTT DATA UK Ltd.
As a Lead Data Migration Engineer, you will thrive in a dynamic and inclusive work environment that prioritises flexibility and continuous professional development. Our commitment to equity and diversity ensures that every employee is valued, while our focus on innovative cloud solutions provides unique opportunities for growth and collaboration with industry experts. Join us to be part of a forward-thinking team dedicated to transforming data migration processes in a supportive and empowering atmosphere.
StudySmarter Expert Advice🤫
We think this is how you could land Lead Data Migration Engineer
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field and let them know you're on the lookout for opportunities. You never know who might have a lead or can refer you to a hiring manager.
✨Tip Number 2
Get involved in relevant online communities or forums. Share your expertise, ask questions, and engage with others in the industry. This not only helps you learn but also puts you on the radar of potential employers.
✨Tip Number 3
Don’t just apply blindly! Tailor your approach for each application. Research the company, understand their data migration challenges, and highlight how your skills can solve those problems when you reach out.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who take the initiative to connect directly with us.
We think you need these skills to ace Lead Data Migration Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV reflects the skills and experiences that match the Lead Data Migration Engineer role. Highlight your experience with AWS, data pipelines, and any relevant projects you've worked on. We want to see how you can contribute to our team!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about data migration and how your background makes you a perfect fit for us. Don’t forget to mention specific technologies like Python, SQL, and AWS Glue that you’ve worked with.
Showcase Your Problem-Solving Skills:In your application, give examples of how you've tackled challenges in data migration or engineering. We love seeing candidates who can think critically and come up with innovative solutions, so don’t hold back!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at StudySmarter!
How to prepare for a job interview at NTT DATA UK Ltd.
✨Know Your Tech Inside Out
Make sure you’re well-versed in AWS services, especially AWS Glue, Python, and SQL. Brush up on your knowledge of ETL/ELT processes and be ready to discuss how you've implemented these in past projects.
✨Showcase Your Problem-Solving Skills
Prepare to share specific examples of challenges you've faced in data migration projects. Highlight your analytical skills and how you approached problem-solving, especially in client-facing situations.
✨Understand the Migration Lifecycle
Familiarise yourself with the full data lifecycle, particularly focusing on migration and transformation. Be ready to discuss how you ensure data integrity and quality throughout the process.
✨Collaborate and Communicate
Emphasise your experience working with cross-functional teams. Be prepared to talk about how you’ve collaborated with architects, analysts, and QA teams to deliver successful migration projects.
