Job Description
Fixed Term Permanent Contract until 31/3/2027Hybrid workingThe Data Engineer is responsible for designing, building, and maintaining our data infrastructure, ensuring the efficient and reliable processing, storage, and analysis of large datasets.
The role will develop and deploy ETL processes from various systems to enhance the data capabilities of the clientThey will contribute to ensuring our data, and data shared by others is of the highest quality, available and usable.
The role requires a good level of knowledge, functional understanding of modern data technologies and platforms.
Design and implement scalable, efficient, and robust data pipelines to extract, transform, and load (ETL) data from various sources into databases.2.Build and link data sets so that the client can easily derive insights from itsWrite ETL scripts to make sure the ETL process performs optimally, leading on extracting data, joining and helping analysts to derive insights.
Troubleshooting and resolving issues as they arise, to ensure the timely delivery of high- quality data.
Identify and automate manual data flows and reports to enable scaling and repeatable use, working with colleagues across the organisation.
Engage and collaborate with teams to understand their data requirements and translate them into technical solutions.
Work closely with data stakeholders to provide support and guidance on how to use thedata engineering infrastructure effectively.
Work with information analysts and BI developers to build optimal and reusable visualisations and reportsExtract, clean, combine and store data in a way that allows it to be exploited and as an asset to help service delivery and decision making.
Support colleagues implementing data quality checks, data validation, and data cleansing processes to help ensure the accuracy, consistency, and integrity of the This may include purging data in accordance with regulation and internal policy.
Adhere to data governance policies and standards, ensuring compliance with data privacy and security regulations.
Anonymise data wherever necessary, working within the principles of GDPR and with suitable data protection and sharing agreements in place.
Document data engineering processes, workflows, and technical specifications to facilitate knowledge sharing and ensure reproducibility of analyses.
Stay up-to-date with emerging trends and advancements in data engineering, evaluating and recommending new tools, techniques, and best practices that will enhance the data engineering infrastructure.
Contribute to data strategy, writing good standards and practice for datao job description added
Data Engineer in Lincoln employer: Data Careers
Join a dynamic and innovative IT consultancy in Northfleet, where collaboration and inclusivity are at the heart of our work culture. We offer competitive salaries, bonuses, and a flexible working arrangement that allows you to balance office and home life effectively. With a strong focus on employee growth and development, we provide ample opportunities for you to advance your career while making a meaningful impact in the industry.
