Data Engineering Lead

Data Engineering Lead

England Full-Time 43200 - 72000 £ / year (est.) No home office possible
B

At a Glance

  • Tasks: Lead the development of a cutting-edge data platform and mentor a team of data engineers.
  • Company: Join LexisNexis IP, a leader in data solutions and innovation.
  • Benefits: Enjoy flexible hours, generous holidays, health perks, and wellbeing programs.
  • Why this job: Be part of a collaborative culture that values growth, innovation, and impactful work.
  • Qualifications: Expertise in Python, PySpark, and Databricks; experience in leading data engineering teams required.
  • Other info: Work-life balance is prioritized with numerous initiatives to support your personal and professional goals.

The predicted salary is between 43200 - 72000 £ per year.

About the Role

As the technical lead for the team building the strategic Data Platform at LexisNexis IP, you will be instrumental in executing our data strategy for the Data Platform. Your role will be pivotal in developing and implementing advanced solutions for data integration, quality control, and continuous delivery, driving our data operations to new heights.

Your expertise will be crucial in embedding best practices and state-of-the-art data engineering tools, ensuring that our workflows are both efficient and scalable.

Responsibilities

  1. Architecting and leading the development of our patent data ingestion pipeline using Databricks, Python, and PySpark.
  2. Mentoring and guiding a team of data engineers, fostering a collaborative environment that encourages growth and innovation. You will enable and lead technical discussions within the team and with stakeholders.
  3. Ensuring the pipeline is efficient, scalable, and robust, capable of handling terabytes of data with low latency. Eliminate inefficiencies and teach the techniques to the team.
  4. Contributing to the overall data engineering strategy and driving the adoption of best practices in coding, architecture, and deployment.
  5. Identifying and resolving technical challenges, ensuring the smooth operation of the data ingestion pipeline.
  6. Automating repetitive tasks to make space for the team to tackle the most challenging upcoming problems.

Requirements

  1. Demonstrate expertise in Python and PySpark, essential for leading the team.
  2. Expertise in Databricks is highly desirable and advantageous.
  3. Ability to design and implement scalable data architectures for both batch and streaming data processing.
  4. Proficiency in using cloud platforms such as AWS, Azure, or Google Cloud for data infrastructure management.
  5. Knowledge of data governance practices, including data quality management, metadata management, and data lineage.
  6. Proven experience in leading and mentoring technical data engineering teams.

Work in a way that works for you

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance, and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

Benefits

  1. Working flexible hours – flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
  2. Generous holiday allowance with the option to buy additional days.
  3. Health screening, eye care vouchers, and private medical benefits.
  4. Wellbeing programs.
  5. Life assurance.
  6. Access to a competitive contributory pension scheme.
  7. Save As You Earn share option scheme.
  8. Travel Season ticket loan.
  9. Electric Vehicle Scheme.
  10. Optional Dental Insurance.
  11. Maternity, paternity, and shared parental leave.
  12. Employee Assistance Programme.
  13. Access to emergency care for both the elderly and children.
  14. RECARES days, giving you time to support the charities and causes that matter to you.
  15. Access to employee resource groups with dedicated time to volunteer.
  16. Access to extensive learning and development resources.
  17. Access to employee discounts scheme via Perks at Work.

#J-18808-Ljbffr

Data Engineering Lead employer: Butterworths Limited Company

At LexisNexis IP, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. As a Data Engineering Lead, you will benefit from flexible working hours, generous holiday allowances, and extensive learning opportunities, all while contributing to a cutting-edge data platform. Our commitment to employee wellbeing is reflected in our numerous initiatives, including health benefits, parental leave, and community support programs, making us a truly rewarding place to grow your career.
B

Contact Detail:

Butterworths Limited Company Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Data Engineering Lead

✨Tip Number 1

Familiarize yourself with Databricks, Python, and PySpark. Since these are essential tools for the role, showcasing your hands-on experience with them during discussions can set you apart from other candidates.

✨Tip Number 2

Highlight your experience in leading and mentoring teams. Be prepared to discuss specific examples of how you've fostered collaboration and innovation within your previous teams, as this is a key responsibility of the role.

✨Tip Number 3

Demonstrate your understanding of scalable data architectures. Prepare to talk about past projects where you designed or implemented solutions for batch and streaming data processing, emphasizing efficiency and robustness.

✨Tip Number 4

Stay updated on cloud platforms like AWS, Azure, or Google Cloud. Being knowledgeable about these infrastructures will not only help you in technical discussions but also show your commitment to best practices in data governance.

We think you need these skills to ace Data Engineering Lead

Expertise in Python
Proficiency in PySpark
Experience with Databricks
Cloud Platform Management (AWS, Azure, Google Cloud)
Data Architecture Design
Batch and Streaming Data Processing
Data Governance Practices
Data Quality Management
Metadata Management
Data Lineage Knowledge
Team Leadership and Mentoring
Technical Problem Solving
Automation of Repetitive Tasks
Collaboration and Communication Skills

Some tips for your application 🫡

Understand the Role: Take the time to thoroughly read the job description for the Data Engineering Lead position. Understand the key responsibilities and requirements, especially the importance of Python, PySpark, and Databricks in the role.

Highlight Relevant Experience: In your CV and cover letter, emphasize your experience with data engineering, particularly in leading teams and developing scalable data architectures. Provide specific examples of projects where you utilized Python, PySpark, and cloud platforms.

Showcase Leadership Skills: Since mentoring and guiding a team is a crucial part of this role, make sure to highlight any previous leadership experiences. Discuss how you've fostered collaboration and innovation within your teams.

Tailor Your Application: Customize your application materials to reflect the language and values mentioned in the job description. Use keywords related to data governance, quality management, and automation to align your application with the company's expectations.

How to prepare for a job interview at Butterworths Limited Company

✨Showcase Your Technical Expertise

Be prepared to discuss your experience with Python, PySpark, and Databricks in detail. Highlight specific projects where you've implemented scalable data architectures or automated processes, as this will demonstrate your capability to lead the team effectively.

✨Emphasize Leadership and Mentoring Skills

Since the role involves mentoring a team of data engineers, share examples of how you've successfully guided teams in the past. Discuss your approach to fostering collaboration and innovation within a technical environment.

✨Discuss Data Governance Knowledge

Prepare to talk about your understanding of data governance practices, including data quality management and metadata management. This knowledge is crucial for ensuring the smooth operation of the data ingestion pipeline.

✨Demonstrate Problem-Solving Abilities

Be ready to discuss specific technical challenges you've faced in previous roles and how you resolved them. This will showcase your ability to identify and tackle issues proactively, which is essential for maintaining an efficient and robust data pipeline.

Data Engineering Lead
Butterworths Limited Company
B
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>