Overview
In this role you will help turn data into strategic insights by building and maintaining data pipelines, data lakes, and data services. You will collaborate with the Data Team to support analytics, reporting, and ML initiatives that guide business decisions. You’ll work on real-time and batch ETL, data warehousing, and a recommender service to enrich user experiences. This is a hands-on, high-impact role in a fast-paced, collaborative data environment at Smarkets.
Pay / Benefits
- Stock Options: vest over 4 years
- Pension Scheme with up to 6% matched contributions
- Health Insurance
- Enhanced Parental Leave
- Hybrid working: 3 days in office, 2 at home
- Learning & Development budget: 1000 per year
Responsibilities
- Develop and maintain real-time and batch Data ETL pipelines
- Keep data lakes and data warehouses (Redshift and BigQuery) healthy
- Create and maintain Flask services and Postgres databases for data access and business entities
- Support automated reporting pipelines and cross-team reporting needs
- Explore data, train and deploy ML models, and maintain the recommender service for sport competitions
Key requirements
- 3+ years of experience
- Experience building ETL pipelines with Python using tools like Luigi or Airflow
- Experience developing Python-based REST APIs / services and integrating with Postgres
- Familiarity with Python data science stack (Pandas, NumPy, scikit-learn)
- Experience training and deploying ML models
- Strong, clean, well-tested code and teamwork orientation
- Bachelor’s in Computer Science, Math or equivalent or relevant experience
- team player
- proactive and collaborative
- communication and knowledge sharing
- Python ETL frameworks (Luigi, Airflow)
- Python-based REST APIs / Flask / FastAPI
- Postgres database access and management
Data Engineer in London employer: Smarkets
Smarkets is an exceptional employer that fosters a high-performance culture where talent thrives, particularly in the dynamic environment of London. As an Accounts Assistant, you will benefit from a competitive salary, comprehensive health insurance, and a generous learning and development budget, all while working alongside a diverse and ambitious team. With flexible working arrangements and a strong emphasis on collaboration and innovation, Smarkets offers a rewarding opportunity for those looking to make a meaningful impact in the world of prediction markets.
