Senior Data Engineer l AWS Glue & Kafka l in City of London
Senior Data Engineer l AWS Glue & Kafka l

Senior Data Engineer l AWS Glue & Kafka l in City of London

City of London Full-Time 48000 - 72000 £ / year (est.) No home office possible
Go Premium
V

At a Glance

  • Tasks: Design and build data pipelines using AWS Glue and Kafka for impactful projects.
  • Company: Join VE3, a forward-thinking IT services company in the heart of London.
  • Benefits: Enjoy a competitive salary, career growth opportunities, and a collaborative work culture.
  • Why this job: Work with cutting-edge tech and make a real difference in data engineering.
  • Qualifications: 10 years of experience in AWS, Kafka, and Python/PySpark required.
  • Other info: Dynamic environment with a focus on innovation and inclusivity.

The predicted salary is between 48000 - 72000 £ per year.

We’re seeking a hands-on Senior Data Engineer with about 10 years of experience to deliver production data pipelines on AWS. You’ll design and build streaming (Kafka) and batch pipelines using Glue/EMR (PySpark), implement data contracts and quality gates, and set up CI/CD and observability. You’ve shipped real systems, coached teams, and documented as you go.

Responsibilities

  • Architect and deliver lake/lakehouse data flows on AWS (S3 + Glue + Glue ETL/EMR).
  • Build Kafka consumers/producers, manage schema evolution, resilience, and DLQs.
  • Implement PySpark transformations, CDC merges, partitioning and optimization.
  • Add quality/observability (tests, monitoring, alerting, lineage basics).
  • Harden security (IAM least privilege, KMS, private networking).
  • Create runbooks, diagrams, and handover materials.

What you’ll bring

  • Deep AWS (Glue, RDS, S3, EMR, IAM/KMS, CloudWatch).
  • Strong Kafka (MSK/Confluent, schema registry, consumer group tuning).
  • Python/PySpark in production with tests and CI/CD.
  • Data modeling (bronze/silver/gold, CDC, SCD2) and data contracts.
  • IaC (Terraform/CDK) and cost/performance tuning experience.
  • Clear communication and stakeholder engagement.

Benefits

  • Work on cutting-edge technologies and impactful projects.
  • Opportunities for career growth and development.
  • Collaborative and inclusive work environment.
  • Competitive salary and benefits package.

Senior Data Engineer l AWS Glue & Kafka l in City of London employer: VE3

At VE3, we pride ourselves on being an excellent employer by fostering a collaborative and inclusive work environment where innovation thrives. As a Senior Data Engineer in the vibrant City of London, you'll have the opportunity to work with cutting-edge technologies while enjoying a competitive salary and comprehensive benefits package. We are committed to your career growth, providing ample opportunities for professional development and the chance to make a significant impact on meaningful projects.
V

Contact Detail:

VE3 Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Senior Data Engineer l AWS Glue & Kafka l in City of London

✨Tip Number 1

Network like a pro! Reach out to your connections in the industry, especially those who work with AWS and Kafka. A friendly chat can lead to insider info about job openings that aren't even advertised yet.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your past projects, especially those involving AWS Glue and Kafka. This gives potential employers a taste of what you can do and sets you apart from the crowd.

✨Tip Number 3

Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've tackled challenges with data pipelines and CI/CD processes. We want to hear your success stories!

✨Tip Number 4

Don't forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search.

We think you need these skills to ace Senior Data Engineer l AWS Glue & Kafka l in City of London

AWS Glue
Kafka
PySpark
Data Pipeline Development
CI/CD Implementation
Data Quality Assurance
Data Modelling
Infrastructure as Code (IaC)
Terraform
Cloud Security (IAM, KMS)
Monitoring and Alerting
Stakeholder Engagement
Python Programming
Streaming Data Processing

Some tips for your application 🫡

Tailor Your CV: Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with AWS Glue, Kafka, and any relevant projects you've worked on. We want to see how your skills match what we're looking for!

Showcase Your Projects: Include specific examples of data pipelines you've built or optimised. If you've implemented CI/CD or worked with PySpark, let us know! We love seeing real-world applications of your skills.

Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points where possible to make it easy for us to read. We appreciate straightforward communication!

Apply Through Our Website: Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!

How to prepare for a job interview at VE3

✨Know Your Tech Inside Out

Make sure you’re well-versed in AWS Glue, Kafka, and PySpark. Brush up on your knowledge of data pipelines, CI/CD processes, and observability tools. Being able to discuss your past projects and how you tackled challenges will show your expertise.

✨Prepare Real-World Examples

Think of specific instances where you’ve designed and built data flows or implemented quality gates. Use the STAR method (Situation, Task, Action, Result) to structure your answers. This will help you convey your experience clearly and effectively.

✨Showcase Your Communication Skills

As a Senior Data Engineer, you’ll need to engage with stakeholders. Practice explaining complex technical concepts in simple terms. This will demonstrate your ability to communicate effectively and work collaboratively within a team.

✨Ask Insightful Questions

Prepare thoughtful questions about the company’s data architecture, team dynamics, and future projects. This shows your genuine interest in the role and helps you assess if the company is the right fit for you.

Senior Data Engineer l AWS Glue & Kafka l in City of London
VE3
Location: City of London
Go Premium

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

V
  • Senior Data Engineer l AWS Glue & Kafka l in City of London

    City of London
    Full-Time
    48000 - 72000 £ / year (est.)
  • V

    VE3

    50-100
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>