At a Glance
- Tasks: Design and develop reusable data pipelines using Apache NiFi, Python, and Java.
- Company: Join a forward-thinking company focused on open-source data integration.
- Benefits: Competitive daily rate, remote work, and the chance to shape innovative data solutions.
- Other info: Contract role with excellent growth potential until December 2026.
- Why this job: Make a real impact by transforming complex datasets and enhancing data integration.
- Qualifications: Experience with Apache NiFi, RDF, SPARQL, Python, and Java required.
The predicted salary is between 63000 - 77000 £ per year.
SR2 is looking for a Data Pipeline Architect to support an open-source data integration programme. Combining architectural ownership with hands-on development, you'll build reusable pipelines that connect systems and transform complex datasets reliably.
The Role
You'll shape the architecture and delivery of a portable data transformation platform, using Apache NiFi alongside Python and Java. The platform must operate across different hosting environments, with a particular focus on RDF data processing and SPARQL. This role suits someone who can turn emerging requirements into practical designs and take those designs through development, testing, deployment and operational support.
Key Responsibilities
- Define the platform architecture, establishing reusable patterns for ingestion, transformation, validation and delivery across batch and streaming workloads.
- Develop and maintain Apache NiFi flows connecting APIs, databases, files, object storage, messaging platforms and SPARQL endpoints.
- Build RDF processing pipelines, map source data into agreed semantic models, and develop SPARQL queries and updates that preserve data meaning and quality.
- Write Python and Java components, including custom integrations and NiFi extensions where required.
- Embed automated testing, monitoring, version control and repeatable deployment, with robust handling of retries, duplicates, failures and recovery.
- Work with engineers and stakeholders to refine requirements, document technical decisions and deliver capabilities against agreed milestones.
Essential Skills and Experience
- Proven experience designing and delivering data integration or ETL platforms using Apache NiFi.
- Practical project experience with RDF triples and SPARQL, including semantic modelling, vocabularies, identifiers and named graphs.
- Hands-on development capability in both Python and Java.
- Experience building reusable pipelines across multiple source systems and data formats.
- Strong understanding of reliable processing, including incremental loads, idempotency, duplicate handling and failure recovery.
- Experience implementing data validation, automated tests, operational monitoring and CI/CD.
- Understanding of secure integration, including authentication, authorisation, TLS and credential management.
- Ability to assess technology trade-offs, turn incomplete requirements into clear specifications and explain designs to technical and non-technical stakeholders.
Desirable Experience
- Apache Jena and Apache Jena Fuseki.
- Apache Kafka and integration with NiFi.
- SHACL or comparable RDF validation approaches.
- Custom NiFi processor or controller service development.
- SPARQL optimisation and performance tuning for large RDF datasets.
- Docker, Kubernetes and open-source development or contributions.
The Details
- Contract role
- Duration: Initially until the end of December 2026
- Rate: Up to £475p/d
- IR35: Outside IR35
- Location: Remote
Data Pipeline Architect | Outside IR35 in London employer: SR2 REC LTD
SR2 REC LTD is an exceptional employer, offering a dynamic work environment in the heart of London where innovation thrives. With a strong focus on employee growth and development, we provide opportunities for our team members to enhance their skills while working on cutting-edge authentication and identity projects. Our collaborative culture fosters teamwork and creativity, making it a rewarding place for professionals looking to make a meaningful impact in the tech industry.
StudySmarter Expert Advice🤫
We think this is how you could land Data Pipeline Architect | Outside IR35 in London
✨Tap into Online Data Science Communities
Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like SR2 REC LTD before they're even advertised!
✨Show Off Your Skills With Projects
Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.
✨Check Out Specialist Job Boards
For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like SR2 REC LTD.
✨Leverage University Resources
If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like SR2 REC LTD.
We think you need these skills to ace Data Pipeline Architect | Outside IR35 in London
Some tips for your application 🫡
Highlight Your Data Projects:When applying for a temporary data science role at SR2 REC LTD, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.
Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!
Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to SR2 REC LTD, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.
Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab SR2 REC LTD’s attention and show the tangible impact of your work.
How to prepare for a job interview at SR2 REC LTD
✨Showcase Your Analytical Skills
For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at SR2 REC LTD.
✨Brush Up on Technical Skills
You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.
✨Highlight Your Adaptability
Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at SR2 REC LTD.
✨Prepare a Portfolio of Your Work
Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at SR2 REC LTD.