At a Glance
- Tasks: Own data pipeline testing, design automation frameworks, and validate outputs using advanced tools.
- Company: Join a forward-thinking company in Stevenage with a focus on innovation and collaboration.
- Benefits: Competitive daily rate, flexible work schedule, and opportunities for professional growth.
- Other info: Inclusive workplace welcoming diverse applicants and offering excellent career development opportunities.
- Why this job: Make a real impact by ensuring data quality and mentoring future talent in a dynamic environment.
- Qualifications: Strong SQL skills, experience in test automation, and a passion for data integrity.
Data Engineer Contract: 6‑month contract initially. Worksite: 3 days per week onsite in Stevenage. Rate: £400–£500 per day via umbrella.
Key Responsibilities
- Take full ownership of data pipeline testing strategy, defining scope, priorities, and standards.
- Design and implement a scalable Pytest‑based automation framework for ETL/data validation.
- Develop robust SQL‑based validation checks (reconciliation, duplicates, nulls, business rules).
- Automate validation of Excel outputs using Pandas and OpenPyXL, ensuring structural and data accuracy.
- Validate XML outputs using lxml and xmlschema, including schema compliance and business‑level rules.
- Own and automate API testing workflows using Postman and Newman.
- Integrate all testing workflows into GitHub Actions, enabling CI/CD‑driven quality gates.
- Build clear, actionable reporting and logging, making failures easy to diagnose and debug.
- Collaborate closely with data engineers to improve testability, catch defects early, and accelerate resolution.
- Mentor and guide junior testers, establishing best practices, code standards, and team workflows.
Key Skills & Experience
- Strong hands‑on experience in testing data pipelines / ETL/ELT systems in complex data environments.
- Advanced SQL skills, with the ability to write complex queries for data validation, debugging, and reconciliation.
- Proven expertise in test automation using Python with Pytest, including building reusable frameworks (fixtures, utilities, modular design).
- Experience using Pandas and OpenPyXL for validating data outputs such as Excel files (structure, values, comparisons).
- Hands‑on experience validating XML data using lxml and xmlschema, including schema (XSD) validation and business rules.
- Solid experience in API testing using Postman and automation using Newman.
- Practical experience implementing CI/CD pipelines using GitHub Actions for automated test execution and quality gates.
- Familiarity with Databricks or similar modern data platforms for large‑scale data processing and validation.
- Strong understanding of data quality principles, including data integrity, transformation validation, and reconciliation techniques.
- Experience in building QA processes from scratch or leading data testing initiatives, with ability to define standards and mentor others.
We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported. We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply.
Data Engineer in Stevenage employer: LA International
As a Data Engineer with us, you'll thrive in a dynamic and inclusive work environment located in Stevenage, where collaboration and innovation are at the forefront of our culture. We offer competitive rates and a flexible work schedule that promotes work-life balance, alongside ample opportunities for professional growth and mentorship. Join us to make a meaningful impact while working with cutting-edge technologies and a supportive team dedicated to excellence.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer in Stevenage
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who’s already in the data engineering field. You never know who might have a lead on your next opportunity!
✨Show Off Your Skills
Create a portfolio showcasing your projects, especially those involving SQL, Python, and automation frameworks. Share it on platforms like GitHub to demonstrate your expertise and make it easier for potential employers to see what you can do.
✨Ace the Interview
Prepare for technical interviews by brushing up on your SQL queries and test automation techniques. Practice common interview questions and be ready to discuss your past experiences with data pipelines and validation processes.
✨Apply Through Our Website
Don’t forget to apply directly through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Data Engineer in Stevenage
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the Data Engineer role. Highlight your experience with data pipelines, SQL, and automation frameworks. We want to see how your skills match up with what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about data engineering and how your background makes you a great fit for our team. Keep it concise but impactful!
Showcase Relevant Projects:If you've worked on any projects that relate to the responsibilities listed in the job description, make sure to mention them. We love seeing real-world applications of your skills, especially in testing and automation.
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It helps us keep everything organised and ensures your application gets the attention it deserves. Don’t miss out!
How to prepare for a job interview at LA International
✨Know Your Data Pipeline Inside Out
Before the interview, make sure you understand the data pipeline testing strategy thoroughly. Be ready to discuss your experience with ETL/ELT systems and how you've defined scope and priorities in past projects. This will show that you can take ownership of the responsibilities outlined in the job description.
✨Show Off Your SQL Skills
Prepare to demonstrate your advanced SQL skills by discussing complex queries you've written for data validation and debugging. You might even want to bring examples of your work or be ready to solve a SQL problem on the spot. This will highlight your ability to handle the technical demands of the role.
✨Talk Automation Like a Pro
Since the role involves building a Pytest-based automation framework, be prepared to share your experiences with test automation using Python. Discuss any reusable frameworks you've built and how you've integrated testing workflows into CI/CD pipelines. This will show your practical knowledge and readiness to contribute from day one.
✨Mentorship Matters
If you've had experience mentoring junior testers, make sure to mention it! Talk about how you've established best practices and code standards in your previous roles. This will demonstrate your leadership potential and commitment to fostering a collaborative team environment, which is key for this position.
