At a Glance
- Tasks: Design and build data processing pipelines using cutting-edge technology.
- Company: Vortexa, a fast-growing tech company revolutionising the energy industry.
- Benefits: Flexible working, private health insurance, and equity options for all staff.
- Other info: Collaborative environment with opportunities for personal and professional growth.
- Why this job: Join a vibrant team tackling real-world problems with AI and satellite data.
- Qualifications: Experience in backend data processing, Python, and a passion for innovation.
The predicted salary is between 63000 - 77000 £ per year.
Vortexa is a fast‑growing international technology business founded to solve the immense information gap that exists in the energy industry. By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa creates an unprecedented view on the global seaborne energy flows in real‑time, bringing transparency and efficiency to the energy markets and society as a whole.
The Data Production Team is responsible for all of Vortexa's data. It ranges from mixing raw satellite data from 600,000 vessels with rich but incomplete text data, to generating high‑value forecasts such as the vessel destination, cargo onboard, ship‑to‑ship transfer detection, dark vessels, congestion, future prices, etc. The team has built a variety of procedural, statistical and machine learning models that enabled us to provide the most accurate and comprehensive view of energy flows.
You will be instrumental in designing and building infrastructure and applications to propel the design, deployment, and benchmarking of existing and new pipelines and ML models. Working with software and data engineers, data scientists and market analysts, you'll help bridge the gap between scientific experiments and commercial products by ensuring 100% uptime and bulletproof fault‑tolerance of every component of the team's data pipelines.
You Are:
- Experienced in building and deploying distributed scalable backend data processing pipelines that can go through terabytes of data daily using AWS, K8s, and Airflow.
- Fluent in Python with solid software engineering fundamentals.
- Driven by working in an intellectually engaging environment with the top minds in the industry, where constructive and friendly challenges and debates are encouraged.
- Excited about working in a start‑up environment: not afraid of challenges, excited to bring new ideas to production, and a positive can‑do will‑do person.
- Passionate about coaching developers, helping them improve their skills and grow their careers.
- Experienced in the full software development life cycle (SDLC), including technical design, coding standards, code review, source control, build, test, deploy, and operations.
Awesome If You:
- Have experience with Apache Kafka and streaming frameworks, e.g., Flink.
- Are familiar with observability principles such as logging, monitoring, and tracing.
- Have experience with web scraping technologies and information extraction.
A vibrant, diverse company pushing ourselves and the technology to deliver beyond the cutting edge. A team of motivated characters and top minds striving to be the best at what we do at all times. Constantly learning and exploring new tools and technologies. Acting as company owners (all Vortexa staff have equity options) in a business‑savvy and responsible way. Motivated by being collaborative, working and achieving together. A flexible working policy accommodating both remote & home working, with regular staff events. Private Health Insurance offered via Vitality to help you look after your physical health. Global Volunteering Policy to help you ‘do good' and feel better.
Seniority Level: Mid‑Senior level
Employment Type: Full‑time
Job Function: Information Technology
Industries: IT Services and IT Consulting
Location: London, England, United Kingdom
Associate Data Engineer employer: Vortexa
Vortexa is an exceptional employer that champions innovation and growth in the energy sector, offering a dynamic work culture where employees can thrive in their product management careers. With a commitment to employee well-being, Vortexa provides flexible hybrid working arrangements, private health insurance, and opportunities for global volunteering, ensuring that team members are supported both personally and professionally. Join us to be part of a forward-thinking company that values creativity, collaboration, and continuous learning in a fast-paced scale-up environment.
