Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and maintain Azure-based data pipelines for impactful education research.
- Company: Join the National Institute of Teaching, dedicated to improving teacher development.
- Benefits: Enjoy 27 days holiday, flexible working, and lifestyle discounts.
- Other info: Diverse team environment with strong support for professional development.
- Why this job: Make a real difference in education through innovative data engineering.
- Qualifications: Experience with Azure Data Factory, T-SQL, and data architecture required.
The predicted salary is between 56667 - 56667 £ per year.
We are seeking a motivated and enthusiastic Senior Data Engineer to join our TED team and play an important role in building and maintaining the technical infrastructure that supports the NIoT and TED.
About Us
The National Institute of Teaching (NIoT) has an unswerving commitment to high-quality, evidence-informed teacher education, and is on a mission to improve teacher and leader development across the education system. A key part of that mission is our Teacher Education Dataset (TED), an ambitious data and research initiative focused on building better evidence about teacher development and what makes teaching impactful.
About the Role
Working at the intersection of data engineering, data and research, the postholder will help develop secure, reliable and scalable systems that enable robust analysis and contribute to high-quality, evidence-informed improvement across the sector.
Corporate Responsibilities
- To ensure that the responsibilities of the role are carried out in a way which reflects the mission and the values of the NIoT.
- To be aware of and observe all policies, procedures, working practices and regulations, and in particular to comply with policies relating to Equal Opportunities, Health and Safety, Confidentiality, Data Protection and Financial Regulations, reporting any concerns to an appropriate person.
- To comply with all reasonable management requests.
Key Responsibilities
- Design, build and maintain Azure-based data pipelines to support the ingestion, transformation and curation of TED datasets.
- Develop and maintain Azure SQL databases and research-facing schemas across raw, transformed and curated data layers.
- Write efficient, secure and well-structured T-SQL to support ingestion, validation, transformation and optimisation.
- Contribute to the development and ongoing refinement of a Common Data Model across multiple education data providers.
- Integrate and harmonise data from school MIS and EdTech platforms, including Bromcom, Arbor and Wonde.
- Build and maintain robust validation, logging, auditing and reconciliation processes to improve data quality and trust.
- Support secure data handling, including pseudonymisation, access control and compliance with data-sharing agreements and security requirements.
- Work closely with analysts, researchers, architects and partners to deliver scalable, analytics-ready data solutions.
- Contribute to agile planning, technical design, documentation and operational handover.
Required Skills and Experience
- Strong experience with Azure Data Factory and Azure SQL Server.
- Strong T-SQL skills, including schema design, stored procedures and query optimisation.
- Experience implementing validation, monitoring, logging and reconciliation controls within data pipelines.
- Strong understanding of secure data architecture and the handling of sensitive personal data.
- Experience with Azure DevOps, version control and CI/CD practices.
- Strong analytical and problem-solving skills, with excellent attention to detail.
- Ability to communicate effectively and work successfully in a multidisciplinary team.
- Experience with education datasets, school MIS systems or EdTech platforms.
- Experience with common data models, longitudinal datasets or research-oriented data infrastructure.
- Experience with Power BI, Fabric or related analytics technologies.
- Experience in a public sector, education or high-governance data environment.
- Interest in applying data engineering to improve education and teacher development.
Working at the National Institute of Teaching
Contract: Permanent, Full Time
Salary: £56,667 per annum (+ London weighting if applicable) + benefits
Benefits
- Generous Annual Leave – 27 days’ holiday a year (plus 8 bank holidays)
- Flexible Working – we offer flexible start and end working times, with hybrid working in place for all roles.
- Pension - Entry to the Local Government Pension Scheme
- Salary Sacrifice Schemes – we offer salary sacrifice schemes for bikes, cars and tech!
- Lifestyle Benefits – We offer discounts on gyms, cinema, retail and much more!
- Parenthood Leave – We offer above the statutory minimum for maternity, adoption and paternity leave.
- Working Environment – We have a stimulating, supportive and rewarding working environment with a dedicated team of likeminded professionals.
- Support – Our Employee Assistance Programme (EAP) provides confidential support for employees on personal or work-related matters.
- Development – We fully support the development of our staff and ensure that you have high level of continuous professional development.
Further Information
We think a wide range of different work and educational experiences could support you to be successful in this role. We encourage applications from all backgrounds, communities and industries, and are committed to employing a team that has diverse skills, experiences and abilities.
This post requires a satisfactory enhanced disclosure from the Disclosure and Barring Service (DBS) with a Children’s Barred List Check and Occupational Health Check is required as a condition of employment.
This document is an overview of the role. The responsibilities will include but will not be limited to those listed above and it is anticipated that the role will evolve over time and as such the duties may change.
We reserve the right to close this vacancy early if we receive a high volume of applications.
Senior Data Engineer employer: Niot
Contact Detail:
Niot Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer
✨Tip Number 1
Network like a pro! Reach out to current employees at the NIoT or in similar roles on LinkedIn. A friendly chat can give you insider info and might just get your foot in the door.
✨Tip Number 2
Prepare for the interview by brushing up on your Azure skills. Be ready to discuss your experience with data pipelines and T-SQL, as these are key for the Senior Data Engineer role.
✨Tip Number 3
Show your passion for education! Be prepared to talk about how your work can impact teacher development and improve educational outcomes. It’s all about aligning with the NIoT's mission.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re serious about joining our team.
We think you need these skills to ace Senior Data Engineer
Some tips for your application 🫡
Tailor Your Application: Make sure to customise your CV and cover letter to highlight your experience with Azure Data Factory, T-SQL, and any relevant education datasets. We want to see how your skills align with our mission at NIoT!
Show Your Passion: Let us know why you're excited about improving teacher development through data engineering. A genuine interest in education and data can really make your application stand out!
Be Clear and Concise: When writing your application, keep it straightforward and to the point. Use bullet points where possible to make it easy for us to see your key achievements and skills.
Apply Through Our Website: Don’t forget to submit your application through our official website! It’s the best way for us to receive your details and ensure you’re considered for the role.
How to prepare for a job interview at Niot
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure Data Factory, Azure SQL Server, and T-SQL. Brush up on your schema design and query optimisation skills, as these will likely come up during the interview. Being able to discuss your past experiences with these technologies confidently will show that you're the right fit for the role.
✨Showcase Your Problem-Solving Skills
Prepare examples of how you've tackled complex data engineering challenges in the past. Think about specific instances where you implemented validation, monitoring, or logging controls within data pipelines. This will demonstrate your analytical abilities and attention to detail, which are crucial for this position.
✨Understand the Education Sector
Familiarise yourself with education datasets, school MIS systems, and EdTech platforms like Bromcom and Arbor. Showing that you understand the context in which the NIoT operates will help you stand out. Be ready to discuss how your technical skills can contribute to improving teacher development and education outcomes.
✨Communicate Effectively
Since you'll be working closely with analysts, researchers, and other team members, practice articulating your thoughts clearly. Prepare to explain complex technical concepts in a way that non-technical stakeholders can understand. Good communication is key to thriving in a multidisciplinary team environment.