Staff Infrastructure Engineer (fully remote) in London

We are looking for a Staff Infrastructure Engineer to lead the technical direction and execution of balenaCloud’s infrastructure and reliability architecture. As our customer base and device fleets expand globally, we need a dedicated technical lead to drive our transition into multi-region hosting and single-tenant dedicated instances, natively within Amazon Web Services (AWS).

At balena, we don't have traditional managers or hierarchy; we rely on high levels of trust, autonomy, and alignment. You will be joining at the Staff Level (Tactical scope / Domain Leader). Given the company strategy (the Why), you define the Tactics and the What, design the How, and heavily participate in the Do.

This role represents a dual leadership mandate: you will operate across both Infrastructure Engineering (planning for immense scale, multi-region hosting, and deep AWS automation) and Reliability Engineering (designing the observability tooling, defining operational procedures, and scaling the team's ability to debug and improve the system). Our infrastructure is deeply rooted in AWS, and we need an engineer who can drop in and be highly effective within this ecosystem immediately.

Your Impact (Responsibilities)

• AWS-Native Architecture: Architect, automate, and optimize deeply integrated AWS environments. You will leverage the right AWS services to build a system that hosts balenaCloud reliably, delivering maximum performance and deep cost/resource optimization on a per-device basis.
• Infrastructure & Reliability: Bridge the gap between building for scale and running for stability. You will not only design the infrastructure but also drive the reliability practices for our growing systems, driving continuous improvement, robust feedback loops, and incident resilience.
• Architect for Massive B2B Scale: Design infrastructure capable of handling enterprise-level loads: billions of requests per week (>30 million/hour) and terabytes of data per day. Your mental model should align with massive B2B platforms rather than B2C media streaming.
• Multi-Region & Single-Tenant Hosting: Own the technical tactics and execution to deploy single-tenant, single-region balenaCloud instances (e.g., dedicated instances in the EU, Australia, US, or Japan) to satisfy strict customer data sovereignty needs.
• Kubernetes at Scale: Architect and manage multiple balenaCloud stacks simultaneously, overseeing the deployment and orchestration of many independent Kubernetes clusters for various customers.
• Decade-Long Reliability: We are responsible for physical devices in the real world that will stay deployed for decades. Short-term, fragile infrastructure solutions are unacceptable, as they risk rendering devices lost in the field. Your designs and implementations must meet our >10-year durability bar.
• Team Enablement & Async Collaboration: You will scale your knowledge across an overwhelmed engineering team. You will document, articulate, and demonstrate decision proposals based on objective facts and empirical evidence, minimizing the need for synchronous calls.

Essential Qualifications

• Experience: Minimum of 6 years of highly relevant professional work experience in infrastructure and reliability engineering.
• Deep AWS Expertise: Proven, hands‑on mastery of the AWS ecosystem. You must be able to navigate, architect, and optimize AWS services with immediate effectiveness.
• Observability & Reliability: Deep understanding of Site Reliability Engineering principles. You have proven experience building highly usable observability tooling, metrics, and monitoring systems from the ground up to support high availability.
• Exceptional Documentation Skills: Strong, hands‑on ability to write clear, actionable, and maintainable technical documentation, scaling plans, and onboarding materials for the team.
• Distributed Systems: Proven experience in multiple geolocation hosting with distributed data and processing, specifically in multi‑tenant SaaS environments.
• Core Stack & Automation: Deep expertise with Kubernetes deployments at scale, managing massive PostgreSQL / RDS databases, and proven mastery of Infrastructure as Code and infrastructure automation.
• Scale Testing: Extensive experience in load and scale testing, specifically handling magnitudes of 10k–100k simultaneous connections.
• Remote & Async Communication: Fluent English. Intrinsic motivation to prioritize open, text‑based communication in a public knowledge base. You actively work to reduce synchronous call time to respect scarce overlapping hours across global time zones.
• Abstract Thinking: Ability to identify, research, and advocate for solutions to complicated problems with minimal technical guidance, working from a defined company strategy.

Preferred Skills (Nice to Have)

• Compliance: Experience deploying solutions into special compliance environments (e.g., federal services, FedRAMP, GovCloud).
• AWS Certifications: High-level AWS certifications (e.g., AWS Certified Solutions Architect - Professional) are a strong bonus.

What “Staff Level” Means for You

To succeed in this role, you should fit the following profile based on our internal leveling guide (Tactical level / Domain Leader).

Given: The Company Strategy and Environment (e.g., "We need to scale our AWS infrastructure to support dedicated regional hosting to satisfy global data sovereignty laws, while improving overall fleet reliability").

You: Define the What and the How (researching AWS networking options, advocating for a specific EKS cluster architecture, writing the scaling plans, observability specs, and IaC), and heavily participate in the Do (hands‑on coding and infrastructure provisioning).

Enable: You elevate the entire company. You remove systemic friction, prevent architectural dead‑ends by identifying doomed approaches early, and mentor Domain Contributors. You back up your decision‑making with solid reasoning. You execute within architectural decisions that hold up over a 10+ year horizon, and raise flags early when tactics or designs threaten that durability.

Benefits

• Competitive salary
• Autonomous vacation allowance
• 12 weeks of paid parental leave for new parents
• Equipment of your choice and hardware for side projects
• Books of your choice to help you in your work
• Annual company gathering in an international location, Balena Summit 2024
• Working with a talented and globally distributed team
• Flexible schedules by default