Описание:
The Climate Data Utility Tech Team develops scalable data pipelines for the Net-Zero Data Public Utility, which provides open and accessible public-good data through its website and APIs.
Задачи:
Design and develop scalable Python data pipelines to read from APIs and structured files such as Excel and Parquet Translate domain- and source-specific business logic into efficient code that transforms source data into structured data for downstream applications Implement data transformations and structuring with Pandas and Pydantic to ensure data quality, consistency, and compliance with business logic Collaborate with data scientists and analysts to support data-driven decision-making Document data engineering processes, including data lineage, data dictionaries, and system architectures Maintain best practices through code reviews, version control, and adherence to industry standards Deploy production-quality code through CI/CD pipelines into the cloud environment Mentor and guide junior team members in data engineering practices
Требования:
7+ Years of experience in data engineering or a similar role Proficiency in Python Experience building and managing data pipelines Knowledge of data warehousing and ETL processes Excellent problem-solving and communication skills
Условия:
Location: London, England, United Kingdom
#J-18808-Ljbffr
data engineer for the Net-Zero Data Public Utility employer: HireHi
TEAM LEWIS is an exceptional employer that fosters a collaborative and innovative work culture, making it an ideal place for Fullstack Developers to thrive. With a commitment to employee growth and development, the agency offers opportunities to work on diverse projects while contributing to meaningful social and environmental causes through the TEAM LEWIS Foundation. Located in a vibrant environment, employees benefit from a supportive team atmosphere that encourages creativity and excellence in all aspects of development.
