Big Data Lead

Big Data Lead

London Full-Time 43200 - 72000 £ / year (est.) No home office possible
1

At a Glance

  • Tasks: Lead the Data Engineering team to build and optimize automated data pipelines using cutting-edge technologies.
  • Company: Join Hexaware Technologies, a global leader in IT services focused on digital transformation and innovation.
  • Benefits: Enjoy competitive salary, health insurance, flexible work options, and 24 days of paid holidays.
  • Why this job: Be part of a diverse, creative community that values innovation and continuous learning.
  • Qualifications: Experience with Databricks, AWS, Python, SQL, and data engineering best practices is essential.
  • Other info: We welcome applicants from all backgrounds and encourage you to apply even if you don't meet every requirement.

The predicted salary is between 43200 - 72000 £ per year.

Job Description

Who we are?

At Hexaware Technologies, we are a leading global IT Services company, dedicated to driving digital transformation and innovation for businesses around the world. Founded in 1990, Hexaware has grown into a global trusted partner for enterprises, offering comprehensive AI empowered services including IT Consulting, Application Development, Infrastructure and Cloud Management and Business Process services.

At Hexaware we are a community of creative, diverse, and open-minded Hexawarians creating smiles through the power of great people and technology.

We pride ourselves on our people-centric culture and commitment to sustainability. Our diverse team of over 30,000 professionals across 30 countries is driven by a shared passion for innovation and excellence. We foster a collaborative environment where creativity and continuous learning are encouraged, enabling our employees to thrive and grow.

Just so you know…

You do not need to be perfect or have perfect qualifications to apply for this job nobody is!

We believe that you do not need to match every requirement for the job position to make a valuable contribution to our team. We want to hear from you if you have the passion and potential to drive our mission forward!At Hexaware, we are committed to building and fostering a team with diverse backgrounds, experiences and skills.We value diversity and inclusion and strive to create a workplace where everyone feels welcome and supported.If you require any reasonable adjustments during the application process, please let us know.

What would you do?

Job Description:

For this role, senior experience of Data Engineering and building automated data pipelines on IBM Datastage & DB2, AWS and Databricks from source to operational databases through to curation layer is expected using the latest cloud modern technologies where experience of delivering complex pipelines will be significantly valuable to how D&G maintain and deliver world class data pipelines.

Knowledge in the following areas essential:

Data Engineering Experience:

  • Databricks: Expertise in managing and scaling Databricks environments for ETL, data science, and analytics use cases.
  • AWS Cloud: Extensive experience with AWS services such as S3, Glue, Lambda, RDS, and IAM.
  • IBM Skills: DB2, Datastage, Tivoli Workload Scheduler, Urban Code
  • Programming Languages: Proficiency in Python, SQL.
  • Data Warehousing & ETL: Experience with modern ETL frameworks and data warehousing techniques.
  • DevOps & CI/CD: Familiarity with DevOps practices for data engineering, including infrastructure-as-code (e.g., Terraform, CloudFormation), CI/CD pipelines, and monitoring (e.g., CloudWatch, Datadog).
  • Familiarity with big data technologies like Apache Spark, Hadoop, or similar.
  • Test automation skills
  • ETL/ELT tools and creating common data sets across on-prem (IBMDatastage ETL) and cloud data stores
  • Leadership & Strategy: Lead Data Engineering team(s) in designing, developing, and maintaining highly scalable and performant data infrastructures.
  • Customer Data Platform Development: Architect and manage our data platforms using IBM (legacy platform) & Databricks on AWS technologies (e.g., S3, Lambda, Glacier, Glue, EventBridge, RDS) to support real-time and batch data processing needs.
  • Data Governance & Best Practices: Implement best practices for data governance, security, and data quality across our data platform. Ensure data is well-documented, accessible, and meets compliance standards.
  • Pipeline Automation & Optimisation: Drive the automation of data pipelines and workflows to improve efficiency and reliability.
  • Team Management: Mentor and grow a team of data engineers, ensuring alignment with business goals, delivery timelines, and technical standards.
  • Cross Company Collaboration: Work closely with all levels of business stakeholder including data scientists, finance analysts, MI and cross-functional teams to ensure seamless data access and integration with various tools and systems.
  • Cloud Management: Lead efforts to integrate and scale cloud data services on AWS, optimising costs and ensuring the resilience of the platform.
  • Performance Monitoring:Establish monitoring and alerting solutions to ensure the high performance and availability of data pipelines and systems to ensure no impact to downstream consumers.
What youll get from us:

Competitive Salary

Company Pension Scheme

Comprehensive Health Insurance

Flexible and hybrid working options dependent on Customer requirements.

24 days paid annual holidays + public holidays.

Professional Development and Training Opportunities

Employee Assistance Program (EAP)

Diversity, Equity, and Inclusion Initiatives

Company Events and Team-Building Activities

Equal Opportunities Employer:

Hexaware Technologies is an equal opportunity employer. We are dedicated to providing a work environment free from discrimination and harassment. All employment decisions at Hexaware are based on business needs, job requirements, and individual qualifications. We do not discriminate based on race including colour, nationality, ethnic or national origin, religion or belief, sex, age, disability, marital status, sexual orientation, parental status, gender reassignment, or any other status protected by law. We encourage candidates of all backgrounds to apply.

Find out more at Hexaware.com.

Big Data Lead employer: 1334926

At Hexaware Technologies, we pride ourselves on being a people-centric employer that fosters a culture of innovation and collaboration. Our commitment to employee growth is reflected in our comprehensive training programs and diverse work environment, where every Hexawarian is encouraged to thrive. With flexible working options and a focus on sustainability, we offer a unique opportunity for Big Data Leads to make a meaningful impact while enjoying a rewarding career.
1

Contact Detail:

1334926 Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Big Data Lead

✨Tip Number 1

Make sure to showcase your experience with Databricks and AWS in your conversations. Highlight specific projects where you've managed and scaled environments, as this is crucial for the Big Data Lead role.

✨Tip Number 2

Demonstrate your leadership skills by discussing how you've mentored teams in the past. Hexaware values team management, so share examples of how you've aligned team goals with business objectives.

✨Tip Number 3

Familiarize yourself with the latest trends in data governance and best practices. Be prepared to discuss how you would implement these in a real-world scenario during your interview.

✨Tip Number 4

Network with current or former Hexaware employees on platforms like LinkedIn. They can provide insights into the company culture and what they look for in candidates, which can help you tailor your approach.

We think you need these skills to ace Big Data Lead

Data Engineering Experience
Databricks Management
AWS Services (S3, Glue, Lambda, RDS, IAM)
IBM DB2 and Datastage Expertise
Proficiency in Python and SQL
Modern ETL Frameworks
Data Warehousing Techniques
DevOps Practices for Data Engineering
CI/CD Pipeline Familiarity
Big Data Technologies (Apache Spark, Hadoop)
Test Automation Skills
Leadership and Team Management
Customer Data Platform Development
Data Governance Best Practices
Pipeline Automation and Optimization
Cross-Company Collaboration
Cloud Management on AWS
Performance Monitoring and Alerting

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights relevant experience in Data Engineering, particularly with IBM Datastage, DB2, AWS, and Databricks. Use specific examples to demonstrate your expertise in building automated data pipelines.

Craft a Compelling Cover Letter: In your cover letter, express your passion for data engineering and innovation. Mention how your background aligns with Hexaware's commitment to diversity and inclusion, and how you can contribute to their mission.

Showcase Leadership Experience: If you have experience leading teams or projects, be sure to include this in your application. Highlight any mentoring roles or team management experiences that demonstrate your ability to guide and grow a team of data engineers.

Highlight Continuous Learning: Mention any recent training, certifications, or courses you've completed related to big data technologies, cloud services, or data governance. This shows your commitment to staying updated in the fast-evolving tech landscape.

How to prepare for a job interview at 1334926

✨Showcase Your Technical Expertise

Be prepared to discuss your experience with data engineering, particularly with IBM Datastage, DB2, AWS, and Databricks. Highlight specific projects where you built automated data pipelines and how you overcame challenges.

✨Demonstrate Leadership Skills

Since this role involves leading a team, be ready to share examples of how you've mentored others or led projects. Discuss your approach to team management and how you align technical goals with business objectives.

✨Emphasize Collaboration

Hexaware values cross-company collaboration, so prepare to talk about your experience working with diverse teams, including data scientists and finance analysts. Share how you ensure seamless data access and integration across different functions.

✨Discuss Best Practices in Data Governance

Be knowledgeable about data governance, security, and quality. Prepare to explain how you've implemented best practices in previous roles and how you ensure compliance and documentation in your data platforms.

Big Data Lead
1334926
1
  • Big Data Lead

    London
    Full-Time
    43200 - 72000 £ / year (est.)

    Application deadline: 2027-03-11

  • 1

    1334926

Similar positions in other companies
Europas größte Jobbörse für Gen-Z
discover-jobs-cta
Discover now
>