Project description
This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue β a foundational shift in how one of the world's largest financial market infrastructure companies handles its data pipelines.During this Mobilisation Phase, you'll work jointly with client's engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will greenlight the full-scale migration.The work is technically rich and highly collaborative: you'll review and validate job inventories spanning hundreds of ETL workflows, define reusable migration patterns and templates, design a validation and reconciliation framework, run a proof-of-concept to stress-test the approach, and navigate client's rigorous internal governance β from Architectural Significance Assessments through Architectural Review Boards to a formal Gate 1 decision.This is the kind of engagement where your recommendations directly shape a multi-phase, multi-million-pound programme: the target-state framework you produce here becomes the blueprint that a larger delivery team will execute against. Perfect opportunity for combining deep data engineering knowledge with architecture leadership, stakeholder influence, and structured delivery planning inside a Tier 1 financial services environment
Responsibilities
- -Wave planning β plan migration waves based on system dependencies and priorities
- -Complexity assessment β evaluate complexity of each workload/job prior to migration
- -Workload analysis β analyze existing batch processes, their dependencies, schedules, and SLAs
- -Orchestration migration strategy β design the strategy for migrating from Control-M to AWS Step Functions (job mapping, dependencies, triggers)
- -Cutover runbook β develop detailed cutover runbooks (steps, rollback points, success criteria)
- -Pod coordination β coordinate across multiple teams/pods involved in the migration
- -Release governance β manage release processes, ensuring quality and compliance with standards prior to deployment
SKILLS
Must have
- -Large-scale migration experience β proven track record on enterprise-scale migration projects
- -Wave planning β hands-on experience planning waves in multi-system migrations
- -Control-M β deep knowledge of Control-M (jobs, schedules, dependencies, calendars)
- -AWS Step Functions β hands-on experience designing and building workflows in Step Functions
- -Risk assessment β experience identifying and mitigating risks in migration projects
- -Data reconciliation β experience validating data/results post-migration (before/after comparison)
- -Release management β experience managing releases in an enterprise environment
Nice to have
- - Experience with other orchestration tools (Airflow, AWS Glue Workflows)
- - AWS certification (Solutions Architect / DevOps Engineer)
- - Knowledge of AWS Lambda, EventBridge (commonly used- alongside Step Functions)
- - Experience in financial domain
#J-18808-Ljbffr
Senior Migration Consultant employer: Luxoft
As a leading bank, we pride ourselves on fostering a dynamic and inclusive work environment that encourages professional growth and collaboration. Our Training Business Analyst role offers the opportunity to engage in impactful projects while working alongside talented teams dedicated to compliance and innovation. With a strong commitment to employee development and a culture that values diverse perspectives, we provide our staff with the tools and support needed to thrive in their careers.