Our client, Clearwater People Solutions, is currently recruiting for a Data Engineer on a 6-month basis to design and implement data ingestion pipelines. The Data Engineer must have solid experience with Azure Databricks and have worked within a regulated environment previously. This position offers a pay rate of £450-£500 per day outside of IR35. It is a hybrid role with 2-3 days in the office in Basingstoke. Key responsibilities and requirements for the Data Engineer: Supporting stakeholders by implementing data products for insights and informed decisions. Designing and implementing performant data ingestion pipelines from multiple sources using Apache Spark, preferably in Azure Databricks. Delivering and presenting proofs of concept for key technology components to the data team and project stakeholders. Integrating end-to-end data pipelines to ensure data quality and consistency from source systems to target repositories. Collaborating with the data team and broader business to support additional project components such as API interfaces, data models, data sharing, and ML endpoints. Proficiency in writing SQL. Strong experience in SQL and Python. Good knowledge of Data Management principles within a Lakehouse Architecture. #J-18808-Ljbffr
Contact Detail:
Clearwater People Solutions Recruiting Team