At a Glance
- Tasks: Design and build data pipelines using AWS Glue and Kafka for impactful projects.
- Company: Join VE3, a forward-thinking IT services company in the heart of London.
- Benefits: Enjoy a competitive salary, career growth opportunities, and a collaborative work culture.
- Why this job: Work with cutting-edge tech and make a real difference in data engineering.
- Qualifications: 10 years of experience in AWS, Kafka, and Python/PySpark required.
- Other info: Dynamic environment with a focus on innovation and inclusivity.
The predicted salary is between 48000 - 72000 £ per year.
We’re seeking a hands-on Senior Data Engineer with about 10 years of experience to deliver production data pipelines on AWS. You’ll design and build streaming (Kafka) and batch pipelines using Glue/EMR (PySpark), implement data contracts and quality gates, and set up CI/CD and observability. You’ve shipped real systems, coached teams, and documented as you go.
Responsibilities
- Architect and deliver lake/lakehouse data flows on AWS (S3 + Glue + Glue ETL/EMR).
- Build Kafka consumers/producers, manage schema evolution, resilience, and DLQs.
- Implement PySpark transformations, CDC merges, partitioning and optimization.
- Add quality/observability (tests, monitoring, alerting, lineage basics).
- Harden security (IAM least privilege, KMS, private networking).
- Create runbooks, diagrams, and handover materials.
What you’ll bring
- Deep AWS (Glue, RDS, S3, EMR, IAM/KMS, CloudWatch).
- Strong Kafka (MSK/Confluent, schema registry, consumer group tuning).
- Python/PySpark in production with tests and CI/CD.
- Data modeling (bronze/silver/gold, CDC, SCD2) and data contracts.
- IaC (Terraform/CDK) and cost/performance tuning experience.
- Clear communication and stakeholder engagement.
Benefits
- Work on cutting-edge technologies and impactful projects.
- Opportunities for career growth and development.
- Collaborative and inclusive work environment.
- Competitive salary and benefits package.
Senior Data Engineer l AWS Glue & Kafka l in City of London employer: VE3
Contact Detail:
VE3 Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer l AWS Glue & Kafka l in City of London
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work with AWS and Kafka. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your past projects, especially those involving AWS Glue and Kafka. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've tackled challenges with data pipelines and CI/CD processes. We want to hear your success stories!
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Senior Data Engineer l AWS Glue & Kafka l in City of London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with AWS Glue, Kafka, and any relevant projects you've worked on. We want to see how your skills match what we're looking for!
Showcase Your Projects: Include specific examples of data pipelines you've built or optimised. If you've implemented CI/CD or worked with PySpark, let us know! We love seeing real-world applications of your skills.
Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points where possible to make it easy for us to read. We appreciate straightforward communication!
Apply Through Our Website: Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!
How to prepare for a job interview at VE3
✨Know Your Tech Inside Out
Make sure you’re well-versed in AWS Glue, Kafka, and PySpark. Brush up on your knowledge of data pipelines, CI/CD processes, and observability tools. Being able to discuss your past projects and how you tackled challenges will show your expertise.
✨Prepare Real-World Examples
Think of specific instances where you’ve designed and built data flows or implemented quality gates. Use the STAR method (Situation, Task, Action, Result) to structure your answers. This will help you convey your experience clearly and effectively.
✨Showcase Your Communication Skills
As a Senior Data Engineer, you’ll need to engage with stakeholders. Practice explaining complex technical concepts in simple terms. This will demonstrate your ability to communicate effectively and work collaboratively within a team.
✨Ask Insightful Questions
Prepare thoughtful questions about the company’s data architecture, team dynamics, and future projects. This shows your genuine interest in the role and helps you assess if the company is the right fit for you.