Data Engineer in City of Westminster

Data Engineer in City of Westminster

City of Westminster Full-Time No working from home possible
A

With market and regulatory momentum driving demand, Agio Ratings is entering a new phase of growth. We\'re seeking an energetic, creative, and experienced Data Engineer to scale mission-critical capabilities and help us win the market.

Responsibilities:

  • Design and implement scalable ETL pipelines using Apache Spark or Apache Flink
  • Build real-time streaming data pipelines to ingest blockchain transaction data
  • Create data validation and QA frameworks to ensure pipeline reliability
  • Design and optimize data schemas for high volume analytical databases
  • Integrate with node APIs (Bitcoin Core, Geth, etc.) and 3rd party data vendors
  • Implement horizontal scaling strategies for compute-intensive data processing algorithms
  • Design fault-tolerant systems with proper error handling and recovery mechanisms.
    This role is only open to candidates based in or willing to commute to London, UK at least 3 days a week.

Qualifications:

  • Distributed computing: Apache Spark (PySpark/Scala), Apache Flink or equivalent
  • Data warehousing: ClickHouse/Snowflake, or similar DBs
  • Data lakes: AWS S3/Glue, Azure Data Lake, GCP BigQuery
  • Programming: Python, Scala, or Java for data pipeline development
  • Streaming: Kafka, Pulsar, or other streaming platforms
  • Cloud Platforms: AWS, Azure, or GCP data services
  • Knowledge of blockchain data formats and parsing techniques
  • Experience working with blockchain node APIs and RPC interfaces
  • Knowledge of data modelling for graph-based analysis
  • Understanding of data compression and storage optimization techniques
  • Competitive pay starting at Β£70,000 per year.
    Agio Ratings is a VC-backed risk analysis firm focused on the digital asset market. Founded in 2022, our all-star team of PhDs developed advanced models that capture the market\'s unique risk factors. We were early in flagging FTX\'s high risk and in recognizing Bybit\'s resilience following a $1.5B hack. Today, our ratings power risk teams at top trading firms, insurance companies, and banks worldwide.
#J-18808-Ljbffr
A

Contact Details:

Agio Ratings Limited Recruitment Team