At a Glance
- Tasks: Design and implement a cutting-edge ClickHouse observability platform for a global banking client.
- Company: Join a forward-thinking tech firm focused on innovative solutions.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Collaborative culture with a focus on mentorship and career development.
- Why this job: Shape the future of data architecture in a dynamic, greenfield environment.
- Qualifications: Experience in data architecture and strong problem-solving skills required.
The predicted salary is between 75600 - 92400 Β£ per year.
We are looking for a ClickHouse Solutions Architect to join our team supporting the design and implementation of a greenfield, enterprise-scale ClickHouse observability platform for a global banking client. This is a genuine greenfield build at significant scale β there is no incumbent platform to inherit or work around. You will be shaping the architecture from first principles, in an environment where the performance, multi-tenancy and retention requirements are demanding enough that the design decisions made early will determine whether the platform holds up in production.
About the project
We are architecting a central repository for three classes of time-series telemetry β metrics, traces and logs β serving the bank's application estate. The system requirements are:
- Ingest path: 3 million events per second sustained, each event carrying a timestamp and full transaction payload
- Read path: Approximately 1,000 concurrent users
- Several hundred real-time dashboards
- Multi-tenancy and workload isolation: Hundreds of distinct application codes as tenants
- Throttling and quota control required on both read and write paths, so that no single tenant can degrade another
- Standards and tooling constraints: OpenTelemetry-native throughout: native OTel agent and native OTel collector. No proprietary components anywhere in the agent or collector pipeline
- Retention and storage tiering: Getting this right means solving for ingest throughput, query concurrency, tenant isolation and storage cost simultaneously β the interesting part of the work is that these pull against each other, and the architecture has to reconcile them rather than optimise for any one in isolation
Key Activities
- Discovery and architecture: Run technical discovery with client stakeholders to establish workload characteristics β query patterns, latency targets, concurrency, ingest volume and velocity, retention and cost envelope. Translate those into a target-state architecture: deployment model (ClickHouse Cloud vs self-managed on Kubernetes/VMs), cluster topology, shard and replica strategy, Keeper configuration, storage tiering.
- Design the data model β table engine selection across the MergeTree family, primary/sort key design, partitioning, projections, materialized views, dictionaries, TTL and object-storage tiering.
- Design the ingestion architecture β streaming (Kafka/Kinesis, Kafka table engine or ClickPipes), batch and CDC paths, idempotency and deduplication strategy, schema evolution.
- Produce sizing and cost modelling, with options and trade-offs rather than a single answer.
- Define the semantic and consumption layer β BI tool integration, API access patterns, downstream contracts.
Build and validation
- Stand up the reference environment and prove the architecture against representative data volumes and query shapes.
- Build and tune the ingestion pipelines to agreed throughput and freshness SLOs.
- Benchmark and tune query performance against the stated latency targets; iterate on the data model where benchmarks disprove the design.
- Establish infrastructure-as-code, CI/CD and environment promotion for schema and configuration changes.
Productionisation
- Define and implement observability β system table monitoring, metrics, alerting thresholds, capacity headroom tracking.
- Establish backup, restore and disaster recovery, and validate them by test.
- Implement security and governance β RBAC, row/column-level access, encryption, network isolation, audit, and any sector-specific compliance requirements.
- Define upgrade, patching and capacity-management procedures.
Client enablement and handover
- Set engineering standards and guardrails the client's teams work within β naming, modelling patterns, query review criteria, anti-patterns.
- Coach and upskill the client's data engineers through pairing, review and structured sessions.
- Run the handover to the client's run team against an agreed readiness checklist.
- Act as escalation point for complex performance and design questions during transition.
Advisory and practice contribution (weighted more heavily at principal level)
- Support pre-sales, bid and scoping work β estimating, technical qualification, solution shaping.
- Build reusable assets, reference architectures and accelerators from delivered work.
- Represent the practice credibly in client and community forums.
Clickhouse Solutions Architect in Slough employer: Colehouse Group
As a Senior Product Delivery Manager at our company, you will be part of a dynamic and innovative team dedicated to transforming our real-time technology platform. We pride ourselves on fostering a collaborative work culture that encourages professional growth and development, offering extensive training opportunities and a clear career progression path. Located in a vibrant tech hub, we provide a stimulating environment where your contributions directly impact our strategic automation initiatives, ensuring a rewarding and meaningful career.