Principal Consultant_ Kafka Admin in London

Principal Consultant_ Kafka Admin in London

London Full-Time 49500 - 60500 £ / year (est.) On-site
Infosys Technologies

At a Glance

  • Tasks: Lead Kafka administration and manage cutting-edge cloud technologies.
  • Company: Join Infosys, a global leader in digital services and consulting.
  • Benefits: Competitive salary, inclusive culture, and opportunities for professional growth.
  • Other info: Diverse and inclusive workplace with excellent career advancement opportunities.
  • Why this job: Make an impact in a dynamic environment while working with innovative tech.
  • Qualifications: 5-10 years in platform/SRE/DevOps with strong Kafka expertise.

The predicted salary is between 49500 - 60500 £ per year.

Role – Kafka Admin lead

Technology – Kafka clusters, Confluent Cloud, Confluent Platform components

Location – London, UK

  • Provision, configure, and manage Kafka clusters (Apache Kafka KRaft or ZooKeeper-backed if legacy), Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, REST Proxy, Control Center), and Confluent Cloud resources.
  • Ensure high availability (HA) and resilience across multi AZ/region deployments; manage partition replication, min.insync.replicas (ISR), and rack awareness.
  • Implement and maintain client quotas, broker quotas, throttling, and back pressure strategies.
  • Plan and execute upgrades/patching with zero/minimal downtime; maintain version currency against EOL and security advisories.
  • Own backup/restore workflows for metadata (e.g., cluster configs), Schema Registry, and Connect configs.
  • Implement authentication (mTLS/SASL: SCRAM, OAUTHBEARER with IdP, or Kerberos if legacy) and authorization (Kafka ACLs, Confluent RBAC).
  • Enforce encryption in transit and at rest, secret management (Vault/AKV/SSM), secure endpoint exposure, and private connectivity (VPC peering/PrivateLink).
  • Govern topic naming conventions, retention policies, schema evolution rules (backward/fully compatible), and PII handling.
  • Maintain audit trails (broker, Schema Registry, Control Center, Confluent Cloud audit logs) and compliance artifacts (SOX, GDPR, HIPAA/PCI as applicable).
  • Coordinate vulnerability management (CVE watch, hardening baselines, CIS/STIG alignment).
  • Deploy and maintain metrics pipelines (JMX Prometheus/Grafana), logs (ELK/OPensearch), and tracing (OpenTelemetry where applicable).
  • Define and monitor SLOs/SLIs (produce/consume latency, end to end lag, broker CPU/heap/file handles, network throughput, GC pauses).
  • Analyze broker hotspots, partition skew, large message handling, compaction and retention settings, and tune GC/JVM for sustained throughput.
  • Implement consumer lag monitoring and alerting with actionable runbooks to prevent data loss or SLA breaches.
  • Model workload growth, topic/partition scaling, storage/IOPS, network egress/ingress, and broker sizing.
  • For Confluent Cloud, optimize environment cluster topic hierarchy, throughput tiers, retention costs, and data flow egress; right size Dedicated vs. Standard clusters.
  • Design partitioning strategies to meet throughput targets while balancing consumer concurrency and avoiding small partitions anti patterns.
  • Automate cluster and topic lifecycle using Terraform (providers for Kafka/Confluent), Helm, GitOps workflows.
  • Operate and scale Kafka Connect with distributed workers; manage connectors (JDBC, Debezium CDC, S3/ADLS/GCS, Elasticsearch, etc.), transforms (SMTs), and converter settings.
  • Administer Schema Registry (compatibility levels, subject naming strategies, serializers/deserializers, schema size & references).
  • Operate ksqlDB and/or Flink for streaming SQL; enforce resource limits and multi tenant governance.
  • Engineer low latency and secure connectivity across data centers/VPCs/VNETs; manage DNS, TLS SANs, LB configurations, advertised.listeners, and inter cluster networking.

Required Skills & Experience

  • 5–10 years in platform/SRE/DevOps; 3+ years dedicated to Kafka/Confluent admin in production.
  • Strong hands on with Apache Kafka internals: brokers, controllers (KRaft), partitions/replication, log segments, compaction/retention.
  • Confluent Platform: Schema Registry, Kafka Connect, ksqlDB, Control Center, Confluent REST APIs; or Confluent Cloud admin (environments, clusters, RBAC, audit logs, networking).
  • Proficiency with Kafka CLI tools and AdminClient usage; deep knowledge of ACLs, quotas, transactions, idempotent producers, and exactly once semantics scenarios.
  • Prometheus/Grafana, JMX exporters, alerting systems (Alertmanager etc).
  • JVM tuning, Linux performance (NUMA, file descriptors, page cache, disk/RAID, XFS), and network tuning (TCP buffers, MTU, jumbo frames where applicable).
  • Linux administration (systemd, journald, kernel params), virtualization/containers (Docker, Kubernetes).
  • Cloud networking (VPC/VNET peering, transit gateways, PrivateLink/Private Service Connect), multi region architectures.

Preferrable

  • Confluent Certified Administrator for Apache Kafka (CCAAK), CKA/CKAD, HashiCorp Terraform Associate, major cloud certs (Azure/AWS/GCP).
  • Experience with Confluent for Kubernetes (CFK) for operator based deployments.

Overview

Infosys is a global leader in next-generation digital services and consulting. We enable clients in 59 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer clients, in 59 countries, as they navigate their digital transformation powered by cloud and AI. We enable them with an AI-first core, empower the business with agile digital at scale and drive continuous improvement with always-on learning through the transfer of digital skills, expertise, and ideas from our innovation ecosystem. We are deeply committed to being a well-governed, environmentally sustainable organization where diverse talent thrives in an inclusive workplace.

All aspects of employment at Infosys are based on merit, competence and performance. We are committed to embracing diversity and creating an inclusive environment for all employees. Infosys is proud to be an equal opportunity employer.

Work Location London Country United Kingdom State / Region / Province London Company ITL UK Interest Group Infosys Limited Job Role Lead Consultant Role Designation description Principal Consultant: BR

Principal Consultant_ Kafka Admin in London employer: Infosys Technologies

Infosys is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration among diverse teams in the heart of London. With a strong commitment to employee growth, we provide continuous learning opportunities and mentorship, ensuring that our consultants are equipped to excel in their roles while contributing to meaningful projects that drive digital transformation for clients worldwide.

Infosys Technologies

Contact Details:

Infosys Technologies Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Principal Consultant_ Kafka Admin in London

✨Join Local Tech Meetups

Get out there and mingle with fellow developers by joining local tech meetups. It’s a fantastic way to meet people who might be working at Infosys Technologies or know someone who does. Plus, you can pick up some trendy tech skills and trends while you're at it!

✨Contribute to Open Source Projects

Show off your coding chops by jumping into open-source projects. Not only does this give you practical experience, but it also gets you noticed in the dev community. You'll create a killer portfolio that speaks volumes about your skills to Infosys Technologies.

✨Tap into Online Developer Communities

Don’t underestimate the power of online developer communities like GitHub, Stack Overflow, and even Reddit. Participate in discussions, share your projects, and build your visibility. We can often find opportunities through these channels that can lead to a full-time gig at companies like Infosys Technologies.

✨Explore Job Boards Specifically for Tech Roles

Keep your eyes peeled on job boards that focus on tech roles. Sites like TechCareers or Stack Overflow Jobs can often have listings for companies like Infosys Technologies that might not show up on broader job sites. Make it a habit to check these regularly, and don’t hesitate to apply directly through our website!

We think you need these skills to ace Principal Consultant_ Kafka Admin in London

Apache Kafka
Confluent Cloud
Kafka clusters management
Schema Registry
Kafka Connect
ksqlDB
REST Proxy

Some tips for your application 🫡

Show off your coding skills:When applying for a software engineering role, it's super important to showcase your coding skills. Make sure your CV includes your tech stack, any relevant programming languages you’re comfortable with, and examples of projects you've worked on. If you have a GitHub profile, link it up! We love to see code in action.

Tailor your portfolio:For a full-time role, we’d expect to see some solid examples of your work in your portfolio. Make sure to include at least two or three projects that highlight your problem-solving skills and your ability to work with different technologies. Focus on the projects that are most relevant to the position at Infosys Technologies.

Craft a killer cover letter:Your cover letter is your chance to stand out—make it personal! Explain why you want to work at Infosys Technologies and how your skills align with the role. Show us your passion for software development. We dig enthusiastic candidates who understand the value of collaboration and continuous learning!

Be clear and concise:When it comes to writing your CV and cover letter, clarity is key. Avoid jargon that could confuse us and stick to simple, direct language. Highlight your achievements with quantifiable results where possible, and keep everything easy to read. A well-organised application goes a long way!

How to prepare for a job interview at Infosys Technologies

✨Brush Up on Your Coding Skills

For a full-time software engineering role, it's crucial that we stay sharp with our coding abilities. Expect technical questions that might involve solving problems on the spot or discussing algorithms. Practise on platforms like LeetCode or HackerRank to get comfortable with the types of questions that often come up.

✨Know Your Tools and Frameworks

Make sure we’re well-acquainted with the tools and technologies listed in the job description. Familiarise ourselves with any specific frameworks or programming languages mentioned. If Infosys Technologies uses React or Node.js, for instance, be ready to discuss how we’ve used them in previous projects or coursework.

✨Showcase Your Projects

Bring along a portfolio that highlights our best work. This could be code samples, GitHub repositories, or any side projects we’ve built. Make sure we can talk through our thought process for each project, especially the challenges we faced and how we solved them—this shows our problem-solving skills in action.

✨Prepare for Behavioural Questions

While technical skills are key, full-time positions also require cultural fit. Be ready to discuss our previous experiences and how we handle teamwork, conflict, and deadlines. Brush up on the STAR method—Situation, Task, Action, Result—to clearly articulate our past experiences when discussing how we've contributed to a team.