At a Glance
- Tasks: Lead the migration of complex data systems to a cutting-edge AWS Lakehouse architecture.
- Company: Join GlobalLogic, a leader in digital engineering and innovation.
- Benefits: Enjoy a competitive salary, health perks, hybrid work options, and a generous training budget.
- Other info: Participate in fun social events and volunteer days while advancing your career.
- Why this job: Make a real impact by modernising data systems in a dynamic, inclusive environment.
- Qualifications: 7+ years in Data Engineering with expertise in AWS, Databricks, and SQL.
The predicted salary is between 63000 - 77000 £ per year.
We are seeking a highly skilled Consultant Data Engineer to be the driving force behind this massive architectural shift. You will be hands-on in moving a highly complex, highly regulated data ecosystem from an on-premise Teradata environment to a cutting-edge AWS “Lakehouse” architecture.
In this role, you will focus on building robust data pipelines, modernizing legacy code, and ensuring flawless data delivery. You will work closely with System Analysts, Automation Engineers, and Data Architects to convert hundreds of legacy scripts into modern dbt models, orchestrate them via Astronomer (Airflow), and establish governed warehousing in Databricks.
Requirements
- Cloud Platforms: Hands-on engineering experience within the AWS ecosystem (S3, IAM, Glue) and deep expertise in Databricks (SparkSQL, PySpark, governed cataloging).
- Modern Data Stack: Strong proficiency in dbt (Core or Cloud) for data transformation and understanding of modern table formats, specifically Apache Iceberg.
- Orchestration: Experience building and maintaining data pipelines using Apache Airflow (Astronomer experience is a strong plus).
- Languages: Expert-level SQL (ability to read Teradata SQL/BTEQ and write highly optimised Spark/Databricks SQL) and strong Python skills for pipeline development and Airflow DAGs.
- Legacy Systems: Familiarity with Teradata architecture and utilities (FastExport, BTEQ) to effectively understand the source systems being decommissioned.
Experience & Qualifications
- Experience: 7+ years of dedicated Data Engineering experience, with a proven track record in complex data migration projects (On-Premise to Cloud).
- Financial Services Background: Experience working in a highly regulated banking or financial services environment is strongly preferred, particularly within Risk or Finance domains.
- Engineering Best Practices: Strong grasp of CI/CD for data pipelines, Git version control, data modelling (Kimball/Inmon), and infrastructure as code (Terraform).
- Communication: Ability to work collaboratively in a fast-paced, cross-functional agile team, effectively communicating technical blockers to technical leads and project managers.
Job responsibilities
- Lakehouse Engineering: Build and maintain scalable data pipelines to migrate Consumer Risk datasets from Teradata to Amazon S3, utilizing Apache Iceberg for the lakehouse layer and Databricks for governed warehousing.
- Code Modernisation (BTEQ to dbt): Perform complex code conversions, transforming up to 500 legacy Teradata BTEQ scripts into modular, version-controlled, and highly performant dbt (data build tool) models.
- Pipeline Orchestration: Design, develop, and monitor complex Directed Acyclic Graphs (DAGs) using Astronomer (Apache Airflow) to orchestrate end-to-end data workflows.
- Data Lineage & Transparency: Integrate pipelines with OpenLineage to ensure complete, end-to-end data traceability, providing the transparency required for regulatory compliance.
- Reconciliation & Parity: Work alongside the QA/Automation team to execute automated reconciliation frameworks, debugging and resolving data discrepancies to ensure strict attribute-level parity and timing equivalence during governed parallel runs.
What we offer
Our goal is to build an inclusive positive culture where everyone can feel comfortable being themselves, empowering people to create their own high standards and therefore more value. We work together to promote fairness while recognising, valuing and embracing differences – providing a transparent support structure and generous training budget to help our people develop skills to progress their career. Our region supports a hybrid model that can flex across a wide spectrum of working options determined by business, customer and individual needs.
You’ll benefit from a comprehensive health and wellness plan, private healthcare (clinical and mental wellbeing), discounted gym memberships, and in-office yoga sessions and massages. We offer a fantastic benefits package including a competitive pension scheme and recognition schemes through bonus/reward initiatives. Colleagues are entitled to an annual volunteering day – so you can take time to support a cause close to your heart. We also love to stay social with trips to the zoo, quiz nights, sports events, theatre trips and much more.
We are an equal opportunities employer. It is our policy to promote an environment free from discrimination, harassment and victimisation, and we actively welcome applications from people with a disability or long-term health condition. As users of the Disability Confident scheme, we guarantee to interview all disabled applicants who meet the minimum essential criteria for this vacancy. We are committed to providing reasonable adjustments. If you require any adjustments for the application process, the interview, or the job itself, or if you need this information in an accessible format, please contact uki-.
About GlobalLogic
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
Consultant Data Engineer IRC302341 in London employer: GlobalLogic
At GlobalLogic, we pride ourselves on being an exceptional employer that fosters a culture of inclusivity and empowerment. Our commitment to employee growth is reflected in our generous training budget and comprehensive health and wellness plans, ensuring that our team members can thrive both personally and professionally. With a flexible hybrid working model and a vibrant social scene, including events and volunteering opportunities, we create an environment where everyone can contribute to meaningful projects while enjoying a balanced work-life experience.
StudySmarter Expert Advice🤫
We think this is how you could land Consultant Data Engineer IRC302341 in London
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like GlobalLogic!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Consultant Data Engineer IRC302341 at GlobalLogic.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like GlobalLogic.
✨Apply Directly through Our Website
When you find a suitable opening like Consultant Data Engineer IRC302341 at GlobalLogic, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Consultant Data Engineer IRC302341 in London
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at GlobalLogic, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at GlobalLogic. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at GlobalLogic
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at GlobalLogic!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
