Staff Backend Engineer - Grafana Second Horizon | UK | Remote

Grafana Labs, the company behind the open observability cloud, is founded on the principles of open source, open standards, open ecosystems, and open culture. Grafana Cloud, our fully managed observability platform, is flexible and built for scale. With Grafana Cloud's actually useful AI, organizations can see, understand, and act on all their disparate data to move at the speed of their ambitions. Today, more than 35 million users and 7,000+ customers trust Grafana Labs to ensure reliability of their applications and systems, resolve incidents quickly, and optimize their telemetry to reduce noise and cost. We are a 100% remote company with 1,600+ team members across 40+ countries. Our team thrives in an innovation-driven environment where transparency, autonomy, and trust fuel everything we do.

The Opportunity: At Grafana Labs, we build observability tools that help users understand, respond to, and improve their systems – regardless of scale, complexity, or tech stack. We recently started a skunkworks initiative with a mission to bring observability to the rest of the business. Our goal is to make Grafana the single best place where humans and AI agents understand and act on real-time data from across the enterprise. As part of this initiative, we are building an AI-native data intelligence system that gives agents reliable, governed access to enterprise context.

What You'll Be Doing:

• Build the core backend services: Design, implement, test, and operate the first services for context ingestion, context indexing, retrieval orchestration, API access, source configuration, and system administration.
• Create a scalable SaaS foundation: Help define and build the architecture for a multi-tenant service, including tenant isolation, usage tracking, quotas, audit logs, background jobs, and reliable service boundaries.
• Power agent-facing retrieval workflows: Build APIs and service interfaces that allow AI agents, MCP tools, CLIs, and internal applications to retrieve relevant context, provenance, confidence signals, and warnings.
• Work across product and infrastructure: Partner with the team to make practical tradeoffs between fast experimentation and long-term reliability, especially as the project moves from prototype to production.
• Operate what you build: Instrument services with metrics, logs, traces, alerts, and dashboards. Use observability tools to understand system behavior and improve reliability.
• Contribute to technical direction: Help shape the architecture, service boundaries, storage choices, API contracts, deployment patterns, and engineering practices for a new product area.
• Effective communication: You’ll be working in a highly dynamic and collaborative environment, so we need someone who can communicate effectively and contribute across teams.
• Ownership and impact: Take full ownership of the AI solutions you develop, ensuring they are not only innovative but also scalable, maintainable, and aligned with real user workflows.

What Makes You a Great Fit:

• Strong engineering skills: Solid experience building production-grade, user-facing software systems.
• AI experience with a practical mindset: You’re familiar with AI technologies and frameworks, and you focus on delivering high-quality solutions that work in the real world.
• Quick iteration and experimentation: You’re comfortable releasing prototypes, collecting feedback, and iterating with a pragmatic mindset.
• Proven initiative: You take ownership and drive projects forward, pushing boundaries to find the most impactful solutions.
• Collaborative attitude: You communicate effectively with your peers and are open to feedback.
• Experience with LLMs, prompt engineering, and building applications powered by GenAI.
• Exposure to working in cloud-native environments (e.g., AWS, GCP, Azure).
• Experience using observability tools to understand and troubleshoot system behavior.

Bonus Points for:

• Experience building or working with agent frameworks or multi-agent workflows.
• Experience as a data analyst or work with data platforms (e.g., Looker, Tableau, PowerBI, Snowflake, DataBricks).
• Experience building tools for data engineering.

How we work: We are a remote-first team that meets regularly over video and does most of our work asynchronously, in writing. We value creativity, diverse perspectives, and clear communication.

Equal Opportunity Employer: Grafana Labs is an equal opportunities employer. We welcome applications from everyone regardless of race, colour, nationality, origin, caste, sex, gender reassignment identity or expression, sexual orientation, age, religion or belief, disability, veteran status, genetic information, pregnancy, maternity, marital, family or carer status, or any other characteristic which is protected by local law.