With market and regulatory momentum driving demand, Agio Ratings is entering a new phase of growth. We\'re seeking an energetic, creative, and experienced Data Engineer to scale mission-critical capabilities and help us win the market.
Responsibilities:
- Design and implement scalable ETL pipelines using Apache Spark or Apache Flink
- Build real-time streaming data pipelines to ingest blockchain transaction data
- Create data validation and QA frameworks to ensure pipeline reliability
- Design and optimize data schemas for high volume analytical databases
- Integrate with node APIs (Bitcoin Core, Geth, etc.) and 3rd party data vendors
- Implement horizontal scaling strategies for compute-intensive data processing algorithms
- Design fault-tolerant systems with proper error handling and recovery mechanisms.
This role is only open to candidates based in or willing to commute to London, UK at least 3 days a week.
Qualifications:
- Distributed computing: Apache Spark (PySpark/Scala), Apache Flink or equivalent
- Data warehousing: ClickHouse/Snowflake, or similar DBs
- Data lakes: AWS S3/Glue, Azure Data Lake, GCP BigQuery
- Programming: Python, Scala, or Java for data pipeline development
- Streaming: Kafka, Pulsar, or other streaming platforms
- Cloud Platforms: AWS, Azure, or GCP data services
- Knowledge of blockchain data formats and parsing techniques
- Experience working with blockchain node APIs and RPC interfaces
- Knowledge of data modelling for graph-based analysis
- Understanding of data compression and storage optimization techniques
- Competitive pay starting at Β£70,000 per year.
Agio Ratings is a VC-backed risk analysis firm focused on the digital asset market. Founded in 2022, our all-star team of PhDs developed advanced models that capture the market\'s unique risk factors. We were early in flagging FTX\'s high risk and in recognizing Bybit\'s resilience following a $1.5B hack. Today, our ratings power risk teams at top trading firms, insurance companies, and banks worldwide.