Staff Software Engineer, Platform Infrastructure in London

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life. Astro, the industry-leading unified DataOps platform powered by Apache Airflow®, accelerates building reliable data products that unlock insights, unleash AI value, and power data-driven applications. Trusted by more than 800 of the world’s leading enterprises, Astronomer lets businesses do more with their data.

Astronomer’s products run on a complex, multi-cloud platform. The work ahead in the Platform team is about building the foundational data systems that our products will depend on for years. We’re looking for a Staff+-level engineer who has built serious data infrastructure before — not pipelines, not transformations, but the storage systems, retrieval infrastructure, and data platforms that sit underneath everything else and that other engineers build on top of.

You’ll join our Platform Engineering team with a mandate to define and deliver this capability from the ground up, with sponsorship and organizational backing to do it properly. This is a foundational role at an interesting moment: your work will directly shape what Astronomer’s products — Astro, Observe, and our IDE — are capable of over the next several years. This role reports directly to the VP responsible for delivering these platforms reliably.

Responsibilities

• Blaze a Trail: Own and develop our data infrastructure strategy and practice, with sponsorship and responsibility to match. Map out what we need, make the calls, and own the outcomes.
• Be an Owner: Be directly involved in deciding what we work on and how we work on it. Make promises, and keep them.
• Do Sensible Things: Make principled build vs. buy assessments and advocate for the right tools for the right job — not the fashionable ones, not the ones already in the estate just because they’re there.
• Garage Door Open: Create and maintain comprehensive internal documentation and decision records for systems and processes. Participate in architectural forums and make principled, open decisions that the rest of the organization can learn from and hold us to.

What You Bring To The Role

• Extensive, hands-on experience designing and building data infrastructure at scale — storage systems, retrieval and indexing infrastructure, data and/or streaming platforms that serve production traffic for multiple teams and products.
• Strong proficiency in Go and deep, practical experience with Kubernetes at the operator level. You know what happens when things go wrong, because you’ve been there.
• In-depth knowledge of the database and data systems landscape — relational, NoSQL, blob, timeseries, vector — and the hard-won experience to know when each is and isn’t the right choice.
• Deep understanding of distributed systems and Non-Abstract Large Systems Design: you can draw the diagram, explain the failure modes, and know which ones to actually care about.
• Experience working across multiple cloud providers (AWS, GCP, Azure) — not just as a consumer, but as someone who has made considered choices between them and understood the trade-offs.
• Experience defining requirements and making and justifying technology choices in cross-functional engineering organisations.
• Strong written and verbal communication skills, with experience working in a globally-distributed team.

Bonus Points If You Have

• Experience with Postgres-compatible managed services (CloudSQL, RDS, AlloyDB) or distributed databases like Spanner, with hands-on experience in provisioning, development practices, and migration.
• Experience building internal data platforms from cloud-native component parts. We have a healthy mix of build vs. buy; sometimes building is the right call.
• Experience working on a SaaS/PaaS product across multiple cloud providers.
• Experience with Apache Airflow.

At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.