Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and maintain Azure-based data pipelines for impactful education research.
- Company: Join the National Institute of Teaching, dedicated to improving teacher development.
- Benefits: Competitive salary, generous annual leave, and additional benefits.
- Other info: Collaborative environment with opportunities for professional growth.
- Why this job: Make a real difference in education through innovative data solutions.
- Qualifications: Strong experience with Azure Data Factory, T-SQL, and data architecture.
The predicted salary is between 56667 - 56667 £ per year.
We are seeking a motivated and enthusiastic Senior Data Engineer to join our TED team and play an important role in building and maintaining the technical infrastructure that supports the NIoT and TED.
About Us
The National Institute of Teaching (NIoT) has an unswerving commitment to high-quality, evidence-informed teacher education, and is on a mission to improve teacher and leader development across the education system. A key part of that mission is our Teacher Education Dataset (TED), an ambitious data and research initiative focused on building better evidence about teacher development and what makes teaching impactful. By bringing together education, research and digital infrastructure, TED will support new insight into how teachers develop, improve and thrive across their careers.
About the Role
The postholder will help develop secure, reliable and scalable systems that enable robust analysis and contribute to high-quality, evidence-informed improvement across the sector.
Corporate Responsibilities
- To ensure that the responsibilities of the role are carried out in a way which reflects the mission and the values of the NIoT.
- To be aware of and observe all policies, procedures, working practices and regulations, and in particular to comply with policies relating to Equal Opportunities, Health and Safety, Confidentiality, Data Protection and Financial Regulations, reporting any concerns to an appropriate person.
- To comply with all reasonable management requests.
Key Responsibilities
- Design, build and maintain Azure-based data pipelines to support the ingestion, transformation and curation of TED datasets.
- Develop and maintain Azure SQL databases and research-facing schemas across raw, transformed and curated data layers.
- Write efficient, secure and well-structured T-SQL to support ingestion, validation, transformation and optimisation.
- Contribute to the development and ongoing refinement of a Common Data Model across multiple education data providers.
- Integrate and harmonise data from school MIS and EdTech platforms, including Bromcom, Arbor and Wonde.
- Build and maintain robust validation, logging, auditing and reconciliation processes to improve data quality and trust.
- Support secure data handling, including pseudonymisation, access control and compliance with data-sharing agreements and security requirements.
- Work closely with analysts, researchers, architects and partners to deliver scalable, analytics-ready data solutions.
- Contribute to agile planning, technical design, documentation and operational handover.
Strong experience with:
- Azure Data Factory and Azure SQL Server.
- T-SQL skills, including schema design, stored procedures and query optimisation.
- Implementing validation, monitoring, logging and reconciliation controls within data pipelines.
- Secure data architecture and the handling of sensitive personal data.
- Azure DevOps, version control and CI/CD practices.
- Analytical and problem-solving skills, with excellent attention to detail.
- Effective communication and successful collaboration in a multidisciplinary team.
- Education datasets, school MIS systems or EdTech platforms.
- Common data models, longitudinal datasets or research-oriented data infrastructure.
- Power BI, Fabric or related analytics technologies.
- Public sector, education or high-governance data environment.
- Interest in applying data engineering to improve education and teacher development.
Contract: Permanent, Full Time
Salary: £56,667 per annum (+ London weighting if applicable) + benefits
Generous Annual Leave – 27 days’ holiday a year (plus 8 bank holidays).
Senior Data Engineer employer: Niot
Contact Detail:
Niot Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer
✨Tip Number 1
Network like a pro! Reach out to current employees at the NIoT or in similar roles on LinkedIn. A friendly chat can give us insights into the company culture and maybe even a referral!
✨Tip Number 2
Prepare for the interview by brushing up on your Azure skills. We know the role requires strong experience with Azure Data Factory and SQL Server, so be ready to showcase your expertise with real examples.
✨Tip Number 3
Show your passion for education! During interviews, share how your data engineering skills can contribute to improving teacher development. We love candidates who align with our mission.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets the attention it deserves. Plus, we’re always looking for motivated individuals to join our TED team!
We think you need these skills to ace Senior Data Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with Azure, T-SQL, and data pipelines. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Share your passion for education and data engineering, and explain why you’re excited about joining our TED team. Let us know how you can contribute to our mission.
Showcase Relevant Projects: If you've worked on projects that relate to education datasets or data infrastructure, make sure to mention them. We love seeing real-world applications of your skills, so don’t hold back!
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It’s the best way for us to receive your application and keep track of it. Plus, it shows you're keen to join our team!
How to prepare for a job interview at Niot
✨Know Your Data Engineering Stuff
Make sure you brush up on your Azure Data Factory and SQL skills before the interview. Be ready to discuss your experience with building data pipelines and how you've handled sensitive data in the past. They’ll want to see that you can talk the talk and walk the walk!
✨Show Your Problem-Solving Skills
Prepare some examples of how you've tackled complex data challenges in previous roles. Think about specific situations where your analytical skills made a difference. This will demonstrate your ability to think critically and contribute to their mission of improving teacher development.
✨Understand Their Mission
Familiarise yourself with the National Institute of Teaching and their goals, especially around the Teacher Education Dataset. Showing that you understand their mission and how your role as a Senior Data Engineer fits into it will set you apart from other candidates.
✨Be Ready for Teamwork Questions
Since this role involves working closely with analysts, researchers, and other team members, be prepared to discuss your experience in multidisciplinary teams. Share examples of how you’ve collaborated effectively and contributed to successful projects in the past.