At a Glance
- Tasks: Lead quality assurance in a large-scale cloud data engineering programme.
- Company: Join Scrumconnect, a dynamic digital transformation consultancy.
- Benefits: Fully remote role with competitive salary and inclusive culture.
- Other info: Diversity-driven environment with opportunities for growth and mentorship.
- Why this job: Make an impact in cloud technology while working with innovative teams.
- Qualifications: Experience in automated testing and strong leadership skills required.
The predicted salary is between 60000 - 80000 € per year.
About Scrumconnect Consulting is a UK-based digital transformation consultancy delivering agile, secure, and scalable technology solutions for public and private sector clients. This is a fully remote role based in India, supporting UK operations and client engagements. The successful candidate will work closely with UK leadership teams and must be comfortable operating within UK regulatory, governance, and delivery frameworks.
About the Role We are looking for an experienced Test Manager to lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services.
This role combines hands-on technical leadership with test strategy ownership. You will be responsible for defining and driving the overall testing approach across automated pipelines, data workflows, cloud infrastructure, and release delivery while managing risks, improving testing standards, and mentoring engineering teams.
The ideal candidate will have strong experience in Big Data and Data Lake environments, including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments.
You will work closely with engineering, DevOps, architecture, and stakeholder teams to ensure quality is embedded throughout the software delivery lifecycle.
Key Responsibilities
- Define, implement, and manage the overall test strategy across cloud-native data platforms and applications
- Lead end-to-end testing activities across data pipelines, cloud services, APIs, and distributed systems
- Establish quality standards, governance processes, and testing best practices across teams
- Drive a quality-first engineering culture across the programme
- Provide leadership, mentoring, and coaching to Test Engineers and QA team members
Automated Testing & Frameworks
- Design, implement, and oversee scalable automated test frameworks for data and application testing
- Build and maintain automated test suites across AWS cloud infrastructure and data workflows
- Enhance existing automation frameworks to improve reliability, coverage, maintainability, and reporting
- Ensure automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence
Big Data & Data Lake Testing
- Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets
- Validate large-scale data ingestion, transformation, and processing workflows
- Ensure data integrity, transformation accuracy, reconciliation, and performance under load
- Oversee PySpark-based data validation and interrogation activities on AWS EMR
- Support testing and monitoring of workflows orchestrated through Apache Airflow
- Drive root cause analysis for production data issues and platform defects
Risk Management & Reporting
- Identify, assess, and communicate quality risks across releases and environments
- Analyse test execution metrics, defects, trends, and quality indicators
- Translate technical findings into clear, prioritised reporting for technical and non-technical stakeholders
- Provide regular status reporting to programme leadership and client stakeholders
CI/CD & DevOps
- Collaborate with DevOps and engineering teams to improve release quality and deployment confidence
- Ensure automated test execution within GitLab CI/CD pipelines
- Support infrastructure testing and validation within Terraform-managed cloud environments
- Contribute to continuous improvement initiatives across testing and delivery processes
Technology Stack
Apache Airflow, Amazon Athena, AWS S3, AWS Glue, AWS EMR, AWS EC2, AWS ECR, AWS DynamoDB, AWS CloudWatch, AWS IAM, Python, SQL, Java, Bash, GitLab CI/CD, Jupyter Notebooks, Apache Spark / PySpark, Terraform, Docker
Key Skills
- Strong proficiency in Python, SQL, Java, and scripting languages such as Bash
- Hands-on experience testing Big Data platforms and Data Lake solutions
- Strong experience with AWS EMR, Apache Airflow, and Jupyter Notebooks
- Experience performing PySpark-based data interrogation, validation, and testing
- Strong knowledge of AWS services including S3, Glue, Athena, EMR, CloudWatch, IAM, DynamoDB, EC2, and ECR
- Experience designing, implementing, and managing enterprise-scale automated test frameworks
- Strong understanding of CI/CD practices using GitLab pipelines
- Experience with infrastructure-as-code tools such as Terraform
- Familiarity with Docker and containerised testing environments
- Understanding of dimensional data models and slowly changing dimensions
- Experience validating structured and unstructured data workflows
- Strong analytical and root cause analysis skills
- Ability to communicate technical risks clearly to stakeholders at all levels
- Experience leading and mentoring QA/Test Engineering teams
Skills & Experience Required
- Proven experience as a Test Manager, Lead Test Engineer, or QA Lead within cloud and data engineering environments
- Strong background in automated testing for cloud-native and data-centric platforms
- Experience testing large-scale data pipelines, transformation processes, and distributed systems
- Experience managing or leading QA/testing teams in Agile delivery environments
- Strong stakeholder management and communication skills
- Experience establishing test governance, reporting, and quality metrics
- Strong problem-solving and decision-making capability
- Experience working within regulated or security-conscious delivery environments
- SFIA Level 5 capability — provides leadership, influences strategy, and drives quality improvements
- Active SC clearance (mandatory)
Diversity and Inclusion At Scrumconnect Consulting, we believe diversity drives innovation and stronger outcomes for our teams and clients. We are committed to creating an inclusive environment where every individual is respected, valued, and supported. We welcome applications from candidates of all backgrounds, experiences, and perspectives.
Test Engineer (SC Cleared) in Newcastle employer: Scrumconnect Limited
Scrumconnect Consulting is an exceptional employer that fosters a collaborative and innovative work culture, allowing Test Engineers to thrive in a fully remote environment while supporting UK operations. With a strong emphasis on employee growth, mentorship, and a commitment to diversity and inclusion, team members are empowered to lead quality assurance initiatives within cutting-edge cloud data engineering programmes. The company offers competitive benefits and the unique advantage of working with advanced technologies in a dynamic, agile setting.
StudySmarter Expert Advice🤫
We think this is how you could land Test Engineer (SC Cleared) in Newcastle
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work at Scrumconnect or similar companies. A friendly chat can sometimes lead to job opportunities that aren't even advertised.
✨Tip Number 2
Prepare for interviews by brushing up on your technical skills and understanding the latest trends in cloud data engineering. We recommend practising common interview questions and scenarios related to AWS and Big Data testing.
✨Tip Number 3
Showcase your experience with automated testing frameworks and CI/CD processes during interviews. Be ready to discuss specific projects where you’ve implemented these practices, as it’ll demonstrate your hands-on expertise.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Test Engineer (SC Cleared) in Newcastle
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Test Engineer role. Highlight your experience with cloud-native platforms and automated testing, as well as any relevant tools like AWS and PySpark. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about quality assurance and how your background makes you a great fit for our team. Don't forget to mention your SC clearance – it's a must for us!
Showcase Your Achievements:When detailing your experience, focus on specific achievements rather than just listing duties. Did you improve testing processes or lead a successful project? We love to see quantifiable results that demonstrate your impact!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands. Plus, it shows us you're serious about joining our team at Scrumconnect!
How to prepare for a job interview at Scrumconnect Limited
✨Know Your Tech Stack
Familiarise yourself with the technologies mentioned in the job description, like AWS services and Apache Airflow. Be ready to discuss your hands-on experience with these tools and how you've used them in past projects.
✨Demonstrate Your Leadership Skills
Since this role involves leading testing activities, prepare examples of how you've successfully managed teams or mentored colleagues. Highlight specific situations where your leadership made a difference in project outcomes.
✨Understand the Testing Strategy
Be prepared to talk about your approach to defining and implementing test strategies. Discuss how you ensure quality across automated pipelines and data workflows, and be ready to share any frameworks you've designed.
✨Communicate Clearly
Practice explaining technical concepts in simple terms, as you'll need to communicate with both technical and non-technical stakeholders. Think of examples where you've effectively translated complex findings into actionable insights.
