At a Glance
- Tasks: Develop and maintain a modern data platform using cutting-edge technologies.
- Company: Join United Welsh, a forward-thinking organisation transforming data management.
- Benefits: Competitive salary, flexible working, and opportunities for professional growth.
- Other info: Be part of a dynamic team driving innovation in data analytics and governance.
- Why this job: Make a real impact on data solutions that enhance services for communities across Wales.
- Qualifications: Experience in data engineering and familiarity with Microsoft Azure technologies.
The predicted salary is between 45000 - 55000 £ per year.
Please note, this vacancy closes at 12pm, midday, on Monday 7th September.
We reserve the right to close this vacancy early if we receive a high volume of suitable applications.
Interviews will take place as and when suitable candidates are identified.
Purpose of Role
The Data Engineer will play a key role in developing, maintaining and continually improving United Welsh's modern data platform.
Working as part of the Data & Insights team, the role will help build reliable, scalable and secure data solutions that support reporting, analytics, operational decision-making and future innovation.
As United Welsh modernises its data estate and explores the future direction of its data platform, the Data Engineer will support the evaluation, testing and implementation of modern data technologies, including Microsoft Fabric and other cloud-based solutions where appropriate.
A key part of this role will be involvement in proof-of-concept and pilot activity for Microsoft Fabric.
The role will help assess whether Fabric is the right long-term platform for United Welsh by testing functionality, performance, scalability, governance, security and business value before wider decisions are made.
The role will work closely with BI Partners, the Data Governance Analyst, business stakeholders and third-party suppliers to ensure quality data is available when and where it is needed.
This is an opportunity to contribute to a growing data capability and help improve outcomes for colleagues and customers across South Wales.
Key Responsibilities
Data Platform Development
- Design, build and maintain data solutions using Microsoft Fabric, Azure Data Lake and related Microsoft technologies where appropriate.
- Develop and support data pipelines that ingest, transform and curate data from a range of internal and external systems.
- Support the ongoing development of a modern Lakehouse-style architecture, including Bronze, Silver and Gold data layers.
- Maintain and enhance trusted, reusable datasets that support reporting, analytics and operational insight.
- Monitor and optimise platform performance, reliability, efficiency and cost awareness.
Microsoft Fabric Proof of Concept / Pilot Activity
- Support the design, delivery and evaluation of Microsoft Fabric proof-of-concept and pilot activity.
- Test Fabric capabilities including Data Factory, Lakehouse, Dataflows, pipelines, semantic models and integration with Power BI.
- Assess if the platform meets criteria such as functionality, scalability, security, governance, performance and business value.
- Record technical findings, risks, dependencies and lessons learned to inform future platform decisions.
- Work with the Data and Insights Manager and wider team to provide clear recommendations based on pilot outcomes.
- Develop transformation logic that cleanses, validates and enriches data for operational and analytical use.
- Create and maintain reusable data sets and semantic models that support reporting and insight requirements.
- Apply good-practice data modelling techniques, including dimensional modelling and star schema design where appropriate.
- Work with business users to understand data requirements and translate them into scalable technical solutions.
Data Migration & System Implementation
- Support system implementation and data migration projects through data mapping, transformation, validation and reconciliation activity.
- Work with business stakeholders and third-party suppliers to understand source and target system requirements.
- Identify and help resolve data quality issues that may impact migration activity or reporting outcomes.
- Help with repeatable migration processes, templates and validation approaches for future implementation activity.
- Support and maintain existing migration solutions developed using SQL Server Integration Services (SSIS), and be comfortable with working with and enhancing established migration processes where appropriate.
- Assist in the transition of migration processes from legacy approaches to modern cloud-based data engineering solutions where appropriate.
Data Quality, Governance & Documentation
- Maintain high standards of data quality, accuracy, completeness and consistency.
- Build quality checks and validation processes into engineering solutions wherever possible.
- Work closely with the Data Governance Analyst to support data standards, classifications, lineage and quality monitoring.
- Create and maintain technical documentation, including data dictionaries, schemas, process flows and solution designs.
- Ensure data engineering activity supports organisational policies, compliance requirements and good governance practice.
Security & Compliance
- Implement and maintain appropriate security controls within data solutions.
- Support role-based access controls and secure handling of sensitive information.
- Contribute to the development of secure and well-governed data products.
- Ensure data engineering activity aligns with GDPR and organisational data protection requirements.
- Use Git-based source control to manage code, configurations and reusable components.
- Contribute to CI/CD processes using Azure Dev Ops and other platform tooling.
- Follow agreed development standards, testing processes and change control procedures.
- Identify opportunities to automate manual processes and improve platform efficiency.
- Support adoption of emerging technologies, including AI-assisted development tools where appropriate.
Collaboration & Ways of Working
- Work collaboratively with BI Partners, the Data Governance Analyst, the Data & Insights Manager and business stakeholders.
- Participate in Agile delivery activity, including sprint planning, reviews and retrospectives.
- Support testing, validation and continuous improvement of data products and solutions.
- Communicate effectively with both technical and non-technical audiences.
- Take ownership of workload, priorities and delivery commitments.
Person Specification
- Experience in data engineering, ETL/ELT development and data integration.
- Experience working with Microsoft Azure data technologies and/or equivalent modern cloud data platforms.
- Experience with Microsoft Fabric, including Data Factory, Lakehouse, Dataflows and Semantic Models.
- Strong knowledge of SQL and data transformation techniques.
- Experience supporting data migration or system implementation projects.
- Experience working with SQL Server Integration Services (SSIS) and maintaining or developing ETL solutions.
- Experience working with cloud-based data platforms and modern data architectures.
- Understanding of data modelling principles and analytics-ready data design.
- Knowledge of data governance, security and data quality principles.
- Experience using source control tools such as Git.
- Exposure to CI/CD processes and Azure Dev Ops or similar tools.
- Experience evaluating, testing or implementing new technologies, platforms or tools within a business environment.
- Ability to work independently and manage competing priorities.
- Strong communication and stakeholder engagement skills.
- Ability to translate business requirements into technical solutions.
- A proactive and continuous improvement mindset.
- Experience with Microsoft Dataverse and integration of Dataverse data into reporting and analytics platforms
- Experience participating in proof-of-concept projects, pilots or technology evaluations.
- Experience supporting data migration or business system implementation projects.
- Knowledge of Python, Spark or Py Spark.
- Experience developing automated data quality checks and monitoring.
- Experience working with large operational systems and datasets.
- Understanding of housing sector data and business processes.
- Experience using AI-assisted engineering or automation tools.
- Experience working in Agile delivery environments.
Why Join United Welsh?
You will be joining a growing Data & Insights team at an exciting stage of its data journey.
United Welsh is modernising how data is collected, managed and used across the organisation, and this role will help build the trusted foundations needed for better reporting, insight and decision-making.
This role offers the chance to work across data engineering, migration, governance, automation, analytics and platform evaluation.
It is particularly suited to someone who wants to broaden their experience, contribute to meaningful work and help shape how data supports services for customers and communities across Wales.
Requirements within the essential criteria of the Personal Requirements will be used for shortlisting purposes.
However, all of the criteria will be considered in the process of making an appointment.
Apply now
The Data Engineer will play a key role in developing, maintaining and continually improving United Welsh's modern data platform.
Working as part of the Data & Insights team, the role will help build reliable, scalable and secure data solutions that support reporting, analytics, operational decision-making and future innovation.
#J-18808-Ljbffr
Data Engineer in Caerphilly employer: United Welsh
At United Welsh, we pride ourselves on being an exceptional employer that values our employees' contributions and fosters a supportive work culture. As a Customer Engagement Co-ordinator, you will enjoy flexible working arrangements, opportunities for professional growth, and the chance to make a meaningful impact in the Housing and Communities Team. Our commitment to high service standards and positive customer experiences ensures that you will thrive in a dynamic environment where your skills are recognised and developed.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer in Caerphilly
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like United Welsh!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Data Engineer at United Welsh.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like United Welsh.
✨Apply Directly through Our Website
When you find a suitable opening like Data Engineer at United Welsh, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Data Engineer in Caerphilly
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at United Welsh, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at United Welsh. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at United Welsh
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at United Welsh!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
