At a Glance
- Tasks: Lead automated testing for cloud data engineering projects and mentor junior engineers.
- Company: Scrumconnect Consulting, a dynamic digital transformation consultancy.
- Benefits: Fully remote role with competitive salary and inclusive culture.
- Other info: Diverse and inclusive workplace that values innovation and collaboration.
- Why this job: Join a cutting-edge team and make a real impact in cloud technology.
- Qualifications: Proven experience in testing, strong Python skills, and active SC clearance.
The predicted salary is between 60000 - 80000 € per year.
About Scrumconnect
Scrumconnect Consulting is a UK-based digital transformation consultancy delivering agile, secure technology solutions for public and private sector clients. This is a fully remote role based in India, supporting our UK operations and client base. You will work closely with our UK leadership team and must be comfortable operating within UK regulatory and legal frameworks.
About the Role
We are looking for a Test Engineer to join a large-scale cloud data engineering programme, operating across a modern AWS-native technology stack including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, and DynamoDB. You will own testing across automated pipelines, data workflows, and cloud infrastructure - identifying risks, championing test frameworks, and coaching colleagues in quality engineering practices. This is a hands-on, technically deep role. You will write code, build and extend test frameworks, and take accountability for test quality across releases, while actively mentoring junior team members.
Key Responsibilities
- Automated Testing
- Design, implement, and maintain automated test suites across data pipelines, cloud services, and applications
- Automate data and application testing tasks and build test coverage using existing or new infrastructure
- Risk Identification & Reporting
- Identify and raise awareness of risks arising from automated test results
- Analyse and report on test activities, results, issues, and risks
- Translate technical findings into clear, prioritised communication
- Framework Development
- Identify, evaluate, and implement new test frameworks
- Enhance existing frameworks to improve testing confidence and coverage
- Pipeline & Data Testing
- Validate data pipelines using Apache Airflow, AWS Glue, Athena, and EMR
- Ensure data integrity, transformation accuracy, and performance under load
- Analyse data in multiple formats to validate new functionality
- Perform production data analysis to identify root causes of issues
- Mentoring & Coaching
- Mentor and advise team members on testing best practices
- Contribute to a quality-first engineering culture
- CI/CD & DevOps
- Integrate and manage automated tests within GitLab CI/CD pipelines
- Ensure automated execution and fast feedback loops
Technology Stack
- Apache Airflow
- Amazon Athena
- AWS S3
- AWS Glue
- AWS EMR
- AWS EC2
- AWS ECR
- AWS DynamoDB
- AWS CloudWatch
- AWS IAM
- Python
- Java
- SQL
- Bash
- GitLab CI/CD
- Jupyter Notebooks
- Apache Spark
- Terraform
- Docker
Key Skills
- Strong proficiency in Python, Java, SQL, and Scripting (e.g., Bash)
- Experience with Apache Airflow for orchestration and log analysis
- Hands-on experience with AWS services (S3, Glue, Athena, EMR, CloudWatch, IAM, DynamoDB, EC2, ECR)
- Experience using GitLab and GitLab CI/CD pipelines
- Ability to analyse data using Jupyter Notebooks and Amazon Athena
- Understanding of Apache Spark and EMR (basic to intermediate)
- Experience with infrastructure as code (Terraform)
- Familiarity with Docker and containerization
- Knowledge of Server Side and client-side encryption
- Understanding of dimensional data models and slowly changing dimensions
- Experience in data creation/generation for testing
- Strong analytical skills for validating data and identifying issues
- Ability to understand how customer requirements translate into functional solutions
Skills & Experience Required
- Proven experience as a Test Engineer or QA Engineer in cloud/data environments
- Strong Python skills for automation, data validation, and test development
- Experience testing data pipelines (data quality, transformation, performance)
- Experience designing or extending automated test frameworks
- Strong problem-solving and root cause analysis skills
- Ability to clearly communicate risks to technical and non-technical stakeholders
- Experience mentoring or coaching junior engineers
- SFIA Level 4 capability - works autonomously and influences others
- Active SC clearance (mandatory)
Diversity and Inclusion
At Scrumconnect Consulting, we believe that diversity drives innovation. We are committed to creating an inclusive environment where every individual is respected, valued, and supported. We welcome applications from candidates of all backgrounds and experiences.
Lead Test Engineer (SC Cleared) in Newcastle upon Tyne employer: scrumconnect ltd
Scrumconnect Consulting is an exceptional employer, offering a fully remote role that allows you to work from India while supporting our UK operations. We foster a collaborative and inclusive work culture, prioritising employee growth through mentorship and hands-on experience with cutting-edge technology in cloud data engineering. Join us to be part of a dynamic team that values innovation and diversity, providing you with the opportunity to make a meaningful impact in both public and private sectors.
StudySmarter Expert Advice🤫
We think this is how you could land Lead Test Engineer (SC Cleared) in Newcastle upon Tyne
✨Tip Number 1
Network like a pro! Reach out to folks in your industry on LinkedIn or at meetups. A friendly chat can lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repo showcasing your projects, especially those related to AWS and automated testing. It’s a great way to demonstrate your expertise beyond just a CV.
✨Tip Number 3
Prepare for interviews by practising common questions and scenarios specific to the role. Think about how you’d tackle challenges in automated testing and data validation – we want to see your thought process!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team.
We think you need these skills to ace Lead Test Engineer (SC Cleared) in Newcastle upon Tyne
Some tips for your application 🫡
Tailor Your CV:Make sure your CV reflects the skills and experiences that match the Lead Test Engineer role. Highlight your proficiency in Python, AWS services, and any experience with automated testing frameworks. We want to see how you fit into our agile, tech-savvy environment!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about this role and how your background aligns with our needs. Don’t forget to mention your experience with cloud data environments and mentoring junior engineers – we love that!
Showcase Your Technical Skills:In your application, be sure to highlight your hands-on experience with tools like Apache Airflow, AWS Glue, and GitLab CI/CD. We’re looking for someone who can dive deep into the tech stack, so let us know how you've tackled similar challenges in the past.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates. Plus, it shows you’re keen on joining our team at Scrumconnect!
How to prepare for a job interview at scrumconnect ltd
✨Know Your Tech Stack
Make sure you’re well-versed in the technologies mentioned in the job description, especially AWS services like S3, Glue, and Athena. Brush up on your Python and Java skills, as you'll likely be asked to demonstrate your coding abilities during the interview.
✨Showcase Your Testing Experience
Prepare to discuss your previous experience with automated testing and data pipelines. Be ready to share specific examples of how you've identified risks and improved test frameworks in past roles. This will show that you can bring valuable insights to the team.
✨Communicate Clearly
Practice translating technical jargon into layman's terms. You’ll need to communicate risks and findings to both technical and non-technical stakeholders, so being able to articulate your thoughts clearly is crucial.
✨Emphasise Mentoring Skills
Since mentoring junior team members is part of the role, think of examples where you've coached others or contributed to a quality-first culture. Highlighting your ability to uplift the team will make you stand out as a candidate.
