Role Overview
We are supporting a public sector client in hiring a NiFi Data Engineer to join a collaborative development team delivering a data Lakehouse architecture across both cloud and on‑premises platforms. This is a hands‑on data engineering role working within Agile sprints across a full software development life cycle, building and maintaining data pipelines, developing data models and handling non‑functional requirements including security, performance and metadata labelling.
This role suits a self‑starting data engineer with experience in Lakehouse architectures, event‑driven design and CI/CD‑integrated development, who is comfortable picking up new technologies quickly and contributing from day one within a fast‑paced, security‑conscious environment.
Responsibilities
- Design, develop and maintain data pipelines within a Lakehouse architecture across cloud and on‑premises platforms.
- Develop data models to support pipeline design, ensuring alignment with broader architectural standards and business requirements.
- Handle non‑functional aspects of pipeline development including security controls, performance optimisation and metadata labelling.
- Implement event sourcing, change data capture and event‑driven architecture patterns within the data platform.
- Develop unit and integration tests for data pipelines as part of a CI/CD‑integrated software development life cycle.
- Collaborate within an Agile development team across sprint planning, code review and iterative delivery.
- Apply Java and Groovy within an object‑oriented design approach to support pipeline development and tooling.
Qualifications
- Proven experience building data pipelines within Lakehouse architectures across cloud or on‑premises environments.
- Must be a UK national with SC clearance held and eligibility & willingness to undertake DV clearance.
- Experience with event sourcing, change data capture and event‑driven architecture patterns.
- Familiarity with Java and Groovy, with a solid understanding of object‑oriented design principles.
- Experience working within an SDLC with an integrated development team using CI/CD tooling including Git.
- Hands‑on experience with Apache NiFi for data pipeline development and orchestration.
- AWS experience including familiarity with EMR, S3 and SQS.
- Awareness of domain‑driven design approaches and architecture.
- Linux awareness and scripting skills.
- PostgreSQL and PL/SQL knowledge.
NiFi Data Engineer (SC Cleared) employer: Montash Limited
Montash Limited is an excellent employer, offering a dynamic work culture that fosters innovation and collaboration in the heart of South England. With a strong focus on employee growth, the company provides opportunities for professional development and the chance to work on impactful projects involving large datasets. The hybrid work model ensures flexibility while maintaining a supportive team environment, making it an attractive place for those seeking meaningful and rewarding employment.
