Описание
The company builds interactive, resettable digital environments where AI agents navigate software, complete tasks, fail, and improve. Its data systems provide a fundamental input for AI systems and training environments.
Задачи
- Design and build scalable systems for acquiring, ingesting, and integrating large, messy, and varied datasets
- Develop validation, sanitisation, and PII-removal layers to ensure data safety and quality
- Solve complex data problems involving duplication, corruption, inconsistent formats, and provenance
- Make architectural decisions across storage, reliability, observability, security, and cost
- Ensure reliable, high-quality data availability for AI training environment engineers
Требования
- Experience building and operating substantial production data systems end-to-end, including architecture, implementation, and production behaviour
- Strong software engineering fundamentals and hands-on coding experience beyond configuring tools
- Experience with large, complex, or messy datasets, including unstructured text, web, and machine-generated data
- Ability to articulate challenges associated with complex datasets
- Sound judgement across storage, processing, reliability, scalability, and cost
- Ability to discuss technical trade-offs
- Comfortable with cloud infrastructure and debugging complex production systems
Условия
Salary up to £200k.
#J-18808-Ljbffr
data engineer for AI training environments in London employer: HireHi
TEAM LEWIS is an exceptional employer that fosters a collaborative and innovative work culture, making it an ideal place for Fullstack Developers to thrive. With a commitment to employee growth and development, the agency offers opportunities to work on diverse projects while contributing to meaningful social and environmental causes through the TEAM LEWIS Foundation. Located in a vibrant environment, employees benefit from a supportive team atmosphere that encourages creativity and excellence in all aspects of development.
