At a Glance
- Tasks: Lead quality assurance in a cutting-edge cloud data engineering programme.
- Company: Join Scrumconnect, a dynamic digital transformation consultancy.
- Benefits: Fully remote role with competitive salary and growth opportunities.
- Other info: Diversity and inclusion are at the heart of our culture.
- Why this job: Make an impact in a fast-paced environment using the latest tech.
- Qualifications: Experience in Big Data testing and strong leadership skills required.
The predicted salary is between 60000 - 80000 £ per year.
About Scrumconnect
Scrumconnect Consulting is a UK-based digital transformation consultancy delivering agile, secure, and scalable technology solutions for public and private sector clients. This is a fully remote role based in India, supporting UK operations and client engagements. The successful candidate will work closely with UK leadership teams and must be comfortable operating within UK regulatory, governance, and delivery frameworks.
About the Role
We are looking for an experienced Test Manager to lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. This role combines hands-on technical leadership with test strategy ownership. You will be responsible for defining and driving the overall testing approach across automated pipelines, data workflows, cloud infrastructure, and release delivery while managing risks, improving testing standards, and mentoring engineering teams.
The ideal candidate will have strong experience in Big Data and Data Lake environments, including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will work closely with engineering, DevOps, architecture, and stakeholder teams to ensure quality is embedded throughout the software delivery lifecycle.
Key Responsibilities
- Test Strategy & Leadership
- Define, implement, and manage the overall test strategy across cloud-native data platforms and applications
- Lead end-to-end testing activities across data pipelines, cloud services, APIs, and distributed systems
- Establish quality standards, governance processes, and testing best practices across teams
- Drive a quality-first engineering culture across the programme
- Provide leadership, mentoring, and coaching to Test Engineers and QA team members
- Automated Testing & Frameworks
- Design, implement, and oversee scalable automated test frameworks for data and application testing
- Build and maintain automated test suites across AWS cloud infrastructure and data workflows
- Enhance existing automation frameworks to improve reliability, coverage, maintainability, and reporting
- Ensure automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence
- Big Data & Data Lake Testing
- Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets
- Validate large-scale data ingestion, transformation, and processing workflows
- Ensure data integrity, transformation accuracy, reconciliation, and performance under load
- Oversee PySpark-based data validation and interrogation activities on AWS EMR
- Support testing and monitoring of workflows orchestrated through Apache Airflow
- Drive root cause analysis for production data issues and platform defects
- Risk Management & Reporting
- Identify, assess, and communicate quality risks across releases and environments
- Analyse test execution metrics, defects, trends, and quality indicators
- Translate technical findings into clear, prioritised reporting for technical and non-technical stakeholders
- Provide regular status reporting to programme leadership and client stakeholders
- CI/CD & DevOps
- Collaborate with DevOps and engineering teams to improve release quality and deployment confidence
- Ensure automated test execution within GitLab CI/CD pipelines
- Support infrastructure testing and validation within Terraform-managed cloud environments
- Contribute to continuous improvement initiatives across testing and delivery processes
Technology Stack
- Apache Airflow
- Amazon Athena
- AWS S3
- AWS Glue
- AWS EMR
- AWS EC2
- AWS ECR
- AWS DynamoDB
- AWS CloudWatch
- AWS IAM
- Python
- SQL
- Java
- Bash
- GitLab CI/CD
- Jupyter Notebooks
- Apache Spark / PySpark
- Terraform
- Docker
Key Skills
- Strong proficiency in Python, SQL, Java, and scripting languages such as Bash
- Hands-on experience testing Big Data platforms and Data Lake solutions
- Strong experience with AWS EMR, Apache Airflow, and Jupyter Notebooks
- Experience performing PySpark-based data interrogation, validation, and testing
- Strong knowledge of AWS services including S3, Glue, Athena, EMR, CloudWatch, IAM, DynamoDB, EC2, and ECR
- Experience designing, implementing, and managing enterprise-scale automated test frameworks
- Strong understanding of CI/CD practices using GitLab pipelines
- Experience with infrastructure-as-code tools such as Terraform
- Familiarity with Docker and containerised testing environments
- Understanding of dimensional data models and slowly changing dimensions
- Experience validating structured and unstructured data workflows
- Strong analytical and root cause analysis skills
- Ability to communicate technical risks clearly to stakeholders at all levels
- Experience leading and mentoring QA/Test Engineering teams
Skills & Experience Required
- Proven experience as a Test Manager, Lead Test Engineer, or QA Lead within cloud and data engineering environments
- Strong background in automated testing for cloud-native and data-centric platforms
- Experience testing large-scale data pipelines, transformation processes, and distributed systems
- Experience managing or leading QA/testing teams in Agile delivery environments
- Strong stakeholder management and communication skills
- Experience establishing test governance, reporting, and quality metrics
- Strong problem-solving and decision-making capability
- Experience working within regulated or security-conscious delivery environments
- SFIA Level 5 capability — provides leadership, influences strategy, and drives quality improvements
- Active SC clearance (mandatory)
Diversity and Inclusion
At Scrumconnect Consulting, we believe diversity drives innovation and stronger outcomes for our teams and clients. We are committed to creating an inclusive environment where every individual is respected, valued, and supported. We welcome applications from candidates of all backgrounds, experiences, and perspectives.
Remote Data Test Engineer (SC Cleared) in Salford employer: scrumconnect ltd
Scrumconnect Consulting is an exceptional employer, offering a dynamic and inclusive work culture that prioritises continuous learning and professional growth. As a Remote AWS DevOps Engineer, you'll have the opportunity to work on impactful digital transformation projects while collaborating with multidisciplinary teams in a supportive environment. With flexible working arrangements and a commitment to diversity, Scrumconnect empowers its employees to thrive and make meaningful contributions to both their careers and the communities they serve.
StudySmarter Expert Advice🤫
We think this is how you could land Remote Data Test Engineer (SC Cleared) in Salford
✨Join Local Tech Meetups
Get out there and mingle with fellow developers by joining local tech meetups. It’s a fantastic way to meet people who might be working at scrumconnect ltd or know someone who does. Plus, you can pick up some trendy tech skills and trends while you're at it!
✨Contribute to Open Source Projects
Show off your coding chops by jumping into open-source projects. Not only does this give you practical experience, but it also gets you noticed in the dev community. You'll create a killer portfolio that speaks volumes about your skills to scrumconnect ltd.
✨Tap into Online Developer Communities
Don’t underestimate the power of online developer communities like GitHub, Stack Overflow, and even Reddit. Participate in discussions, share your projects, and build your visibility. We can often find opportunities through these channels that can lead to a full-time gig at companies like scrumconnect ltd.
✨Explore Job Boards Specifically for Tech Roles
Keep your eyes peeled on job boards that focus on tech roles. Sites like TechCareers or Stack Overflow Jobs can often have listings for companies like scrumconnect ltd that might not show up on broader job sites. Make it a habit to check these regularly, and don’t hesitate to apply directly through our website!
We think you need these skills to ace Remote Data Test Engineer (SC Cleared) in Salford
Some tips for your application 🫡
Show off your coding skills:When applying for a software engineering role, it's super important to showcase your coding skills. Make sure your CV includes your tech stack, any relevant programming languages you’re comfortable with, and examples of projects you've worked on. If you have a GitHub profile, link it up! We love to see code in action.
Tailor your portfolio:For a full-time role, we’d expect to see some solid examples of your work in your portfolio. Make sure to include at least two or three projects that highlight your problem-solving skills and your ability to work with different technologies. Focus on the projects that are most relevant to the position at scrumconnect ltd.
Craft a killer cover letter:Your cover letter is your chance to stand out—make it personal! Explain why you want to work at scrumconnect ltd and how your skills align with the role. Show us your passion for software development. We dig enthusiastic candidates who understand the value of collaboration and continuous learning!
Be clear and concise:When it comes to writing your CV and cover letter, clarity is key. Avoid jargon that could confuse us and stick to simple, direct language. Highlight your achievements with quantifiable results where possible, and keep everything easy to read. A well-organised application goes a long way!
How to prepare for a job interview at scrumconnect ltd
✨Brush Up on Your Coding Skills
For a full-time software engineering role, it's crucial that we stay sharp with our coding abilities. Expect technical questions that might involve solving problems on the spot or discussing algorithms. Practise on platforms like LeetCode or HackerRank to get comfortable with the types of questions that often come up.
✨Know Your Tools and Frameworks
Make sure we’re well-acquainted with the tools and technologies listed in the job description. Familiarise ourselves with any specific frameworks or programming languages mentioned. If scrumconnect ltd uses React or Node.js, for instance, be ready to discuss how we’ve used them in previous projects or coursework.
✨Showcase Your Projects
Bring along a portfolio that highlights our best work. This could be code samples, GitHub repositories, or any side projects we’ve built. Make sure we can talk through our thought process for each project, especially the challenges we faced and how we solved them—this shows our problem-solving skills in action.
✨Prepare for Behavioural Questions
While technical skills are key, full-time positions also require cultural fit. Be ready to discuss our previous experiences and how we handle teamwork, conflict, and deadlines. Brush up on the STAR method—Situation, Task, Action, Result—to clearly articulate our past experiences when discussing how we've contributed to a team.
