At a Glance
- Tasks: Engineer data pipelines on AWS, modernise legacy workloads, and support reporting use cases.
- Company: Leading tech firm in London with a focus on innovation and collaboration.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Work in an Agile environment with excellent career advancement opportunities.
- Why this job: Join a dynamic team and make an impact in data engineering for government projects.
- Qualifications: Experience with AWS, PySpark, SQL, and CI/CD practices required.
The predicted salary is between 60000 - 75000 £ per year.
Whitehall Resources currently require an experienced Data Engineer to work with a key client based in London.
Please note this role falls INSIDE IR35.
What you’ll do:
- Engineer production grade data pipelines on AWS (EMR, S3, Lambda), using PySpark/Python and SQL, with a focus on performance, resilience, testing, and observability.
- Migrate and modernise legacy workloads (e.g., ETL jobs and reporting feeds) onto cloud native services, creating reusable components and shared frameworks.
- Support reporting & MI use cases, including transformations and data models that feed downstream tools (e.g., Power BI).
- Own CI/CD and version control practices (e.g., Git/GitLab), review code, and enforce engineering standards.
- Coach and mentor engineers, provide technical guidance/code reviews, and contribute to architectural decisions across squads.
- Work in Agile delivery, collaborating across product, data, and platform teams using Jira/Confluence; translate requirements into robust engineering tasks.
- Embed security and compliance by design, aligning with BPSS/SC constraints and department data handling policies.
Essential skills & experience:
- Hands on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large scale batch processing.
- Data engineering at scale in government or similarly complex domains, including performance tuning and data quality management.
- CI/CD & DevOps: pipelines and IaC (e.g., Terraform), automated testing, and release governance.
- Version control & collaboration: Git/GitLab, code review, branching strategies, and trunk/PR workflows.
- APIs & integration: building/consuming data services to move and expose data safely and reliably.
- Agile ways of working with Jira/Confluence; clear stakeholder communication and concise technical documentation.
- Security clearance: BPSS (minimum) and SC cleared or SC clearable for UK government work.
Desirable:
- Data warehousing & modeling (e.g., Redshift; dimensional modeling; dbt).
- Basic Power BI familiarity to partner with BI developers and validate end to end data flows.
- AWS ecosystem depth (Athena, Redshift, EC2, CloudWatch, IAM) and event driven patterns.
Certifications (nice to have):
- AWS Certified Cloud Practitioner (or higher), Azure AI Fundamentals (awareness of ML/AI services).
SFIA Level 4 (Enable) alignment:
- Autonomy: Works under general direction; plans own work; designs and implements PySpark jobs on EMR, modernising legacy code with minimal supervision.
- Influence: Shapes standards through code reviews and mentoring; influences delivery outcomes across teams.
- Complexity: Handles substantial, multifaceted engineering tasks (e.g., migration to new MI platform; data quality resolution; estimating effort).
- Business skills: Communicates effectively with stakeholders; aligns data products to reporting/decision making needs; contributes to Agile ceremonies.
Data Engineer - Informatica in London employer: Whitehall Resources
At Whitehall Resources, we pride ourselves on being an exceptional employer, offering a dynamic work environment in the heart of London. Our culture fosters collaboration and innovation, providing ample opportunities for professional growth through mentorship and hands-on experience with cutting-edge technologies like AWS and PySpark. Join us to be part of a team that values your contributions and supports your career development while working on impactful projects in a complex domain.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer - Informatica in London
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who’s already in the data engineering game. You never know who might have the inside scoop on job openings or can refer you directly.
✨Show Off Your Skills
Don’t just tell them what you can do; show them! Create a portfolio of your projects, especially those involving AWS, PySpark, and SQL. Share your GitHub link when you apply through our website, so they can see your coding chops in action.
✨Ace the Interview
Prepare for technical interviews by brushing up on your AWS and Spark knowledge. Practice common data engineering problems and be ready to discuss your past projects. Remember, they want to see how you think and solve problems, so don’t hold back!
✨Follow Up
After your interview, send a quick thank-you email to express your appreciation for the opportunity. It shows you’re genuinely interested and keeps you fresh in their minds. Plus, it’s a great chance to reiterate why you’d be a perfect fit for the role!
We think you need these skills to ace Data Engineer - Informatica in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Data Engineer role. Highlight your experience with AWS, PySpark, and SQL, and don’t forget to mention any relevant projects that showcase your skills in data pipelines and cloud services.
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how your background aligns with our needs. Be specific about your experience with CI/CD practices and Agile methodologies.
Showcase Your Technical Skills:When filling out your application, make sure to list all your technical skills clearly. Mention your hands-on experience with tools like Git, Terraform, and Power BI, as well as any certifications you hold. We love seeing what you can bring to the table!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it makes the process smoother for everyone involved!
How to prepare for a job interview at Whitehall Resources
✨Know Your Tech Inside Out
Make sure you’re well-versed in AWS, PySpark, and SQL. Brush up on your experience with Amazon EMR, S3, and Lambda, as these are crucial for the role. Be ready to discuss specific projects where you've engineered data pipelines or migrated legacy workloads.
✨Showcase Your CI/CD Knowledge
Familiarise yourself with CI/CD practices and tools like Git and GitLab. Prepare to explain how you've implemented version control and automated testing in past projects. Highlight any experience you have with Terraform or similar tools, as this will show your readiness for the role.
✨Demonstrate Agile Experience
Since the role involves working in Agile teams, be prepared to talk about your experience with Jira and Confluence. Share examples of how you've collaborated with cross-functional teams and translated requirements into engineering tasks. This will show that you can thrive in their work environment.
✨Emphasise Security Awareness
Security is a big deal in this role, so make sure you understand BPSS and SC clearance requirements. Discuss how you've embedded security and compliance in your previous projects. This will demonstrate that you take data handling policies seriously and can align with their standards.
