Member of Technical Staff (Model Quantization & Inference)

Member of Technical Staff (Model Quantization & Inference)

Full-Time 63000 - 77000 £ / year (est.) On-site
L

At a Glance

  • Tasks: Develop cutting-edge low-bit language models and collaborate on innovative hardware solutions.
  • Company: Join Lamb Labs, a pioneering tech company focused on AI chip development.
  • Benefits: Enjoy competitive salary, flexible work options, and opportunities for professional growth.
  • Other info: Be part of a small, dynamic team driving innovation in machine learning and computer architecture.
  • Why this job: Make a real impact in AI by solving challenging problems in model quantization.
  • Qualifications: Deep expertise in language models and hands-on experience with low-precision inference.

The predicted salary is between 63000 - 77000 £ per year.

About Lamb Labs

At Lamb Labs, we're building a new AI chip: the Model Processing Unit (MPU).

Modern AI inference is constrained by the cost of moving model weights between memory and compute.

We're taking a fundamentally different approach: aggressively compressing and optimizing language models so that their weights and computation can be encoded directly into silicon.

We're developing extremely low-bit language models and custom hardware architectures together, with the goal of making inference orders of magnitude faster and more energy-efficient.

We're a small, research-driven team working at the intersection of machine learning, compilers and computer architecture.

We care about fundamental ideas, rigorous experimentation and turning research into working systems.

The Role

We're looking for an exceptional ML engineer or researcher to work on some of the hardest problems in low-bit language model inference.

You'll help develop the models and algorithms that make our hardware architecture possible.

Our focus is on pushing language models to extremely low precision, particularly

1–2-bit weights while preserving as much model quality as possible.

But this goes well beyond weight quantization.

You'll work across activation quantization, KV-cache optimization, attention, numerical representations, training and fine‑tuning, and the broader challenges of running highly compressed language models efficiently.

We're not looking for someone who simply knows how to use existing quantization libraries.

We want someone who understands these methods deeply, can identify their limitations, and can develop better ones.

You'll have broad ownership of the problem, from understanding the mathematical and numerical behavior of models to implementing new techniques, running experiments and working directly with our hardware team.

At Lamb Labs, the model and the chip are designed together.

Your research will directly influence how we build our silicon.

  • What You’ll Work On
  • Extreme low-bit quantization
  • Develop and improve methods for quantizing large language models to sub-4-bit precision, particularly 1–2 bits per weight.
  • Investigate binary, ternary, mixed-precision and other hardware-efficient representations.
  • Understand and overcome the quality degradation caused by aggressive quantization.
  • Activations, attention and KV-cache
  • Explore low-bit activation quantization, including outlier handling, scaling, dynamic ranges and numerical stability.
  • Develop methods for reducing KV-cache memory requirements while preserving attention quality and long-context capabilities.
  • Investigate alternative attention implementations and model representations that are more efficient in hardware.
  • Training, fine‑tuning and model quality
  • Work across post‑training quantization (PTQ), quantization‑aware training (QAT), fine‑tuning, distillation and retraining where appropriate.
  • Develop methods to recover model quality after extreme compression.
  • Understand how architectural choices, training procedures and quantization interact.
  • Hardware‑aware model optimization
  • Collaborate closely with our FPGA and ASIC engineers to develop models and algorithms that map efficiently onto custom silicon.
  • Explore trade‑offs between model quality, bit width, computational complexity, storage and hardware efficiency.
  • Help determine which operations and numerical representations should be supported directly in hardware.
  • Inference research and engineering
  • Build and improve inference implementations for highly compressed language models.
  • Understand and optimize transformer inference, including prefill, decode, attention and KV-cache behavior.
  • Design rigorous experiments and evaluations to measure model quality, latency, throughput and resource requirements.

You’ll have significant freedom to pursue the approaches that work, whether that means developing new quantization algorithms, modifying model architectures, improving training procedures or rethinking how inference is performed.

What We're Looking For

We're looking for someone with genuinely deep technical expertise in language models, model compression or low‑precision inference.

You might be a researcher who has developed novel quantization techniques, an engineer who has spent years optimizing LLM inference, or someone who has independently built exceptional systems.

We care much more about what you've done and what you understand than your title or credentials.

Ideally, you have

  • Deep understanding of modern transformer‑based language models and their inference behavior.
  • Strong experience with model quantization, compression or low‑precision numerical computation.
  • Hands‑on experience working with sub‑4-bit models, ideally including 1–2‑bit quantization.
  • Understanding of weight and activation distributions, quantization error, outliers and numerical stability.
  • Strong Python and Py Torch skills, including the ability to modify models, training procedures and inference implementations.
  • Experience designing and running rigorous experiments, diagnosing model quality regressions and evaluating trade‑offs.
  • The ability to read research papers critically, develop original ideas and turn them into working implementations.
  • A high degree of independence, curiosity and ownership.
  • We're particularly excited about candidates with a

Ph D or equivalent depth of research and engineering experience in machine learning, computer architecture, numerical optimization or a related field.

A Ph D is not required.

Significant original research, open‑source contributions or exceptional industry experience can be equally compelling.

Particularly Interesting Experience

Any of the following would be especially relevant

  • 1‑bit, 1.58‑bit, binary, ternary or other extreme low‑bit language models.
  • Research or implementation experience with Bit Net, GPTQ, AWQ, Qu IP#, AQLM, HQQ or related quantization methods.
  • Quantization‑aware training, post‑training quantization, knowledge distillation or low‑bit fine‑tuning.
  • KV‑cache quantization, compressed attention or long‑context inference optimization.
  • Activation quantization, outlier mitigation, mixed‑precision methods or alternative numerical formats.
  • Developing or modifying transformer architectures for efficient inference.
  • Custom inference kernels using CUDA, Triton or similar low‑level frameworks.
  • Experience with inference systems such as v LLM, SGLang or llama. cpp.
  • Hardware‑aware ML, accelerator‑aware quantization or collaboration with FPGA/ASIC teams.
  • Publications, open‑source projects or substantial original technical contributions in any of these areas.

You don't need experience with all of these.

Exceptional depth in one area, combined with the ability and ambition to tackle the others, is exactly what we're looking for.

Why Lamb Labs?

Work on fundamental problems.

Extreme low‑bit inference is still an open research area. You'll have the opportunity to develop new methods rather than simply apply established ones.

Design models and hardware together.

Your work won't be constrained by the assumptions of existing GPU architectures. You'll help shape the numerical representations and computations that go into our custom silicon.

Own your work end to end.

You'll have the freedom to pursue an idea from first principles through experiments, model training and implementation.

Work with exceptional technical depth.

We're building a small team of people who want to solve difficult problems across machine learning and computer architecture.

See research become real hardware.

Your work will directly contribute to the models and algorithms implemented in our FPGA prototypes and future ASICs.

We're looking for people who are excited by questions like: _How much intelligence can we preserve in a 1‑bit model?

Can we quantize activations and KV caches just as aggressively as weights?

What if we designed the model around the hardware from the beginning?_ If these are the kinds of problems you think about, we'd love to hear from you.

Member of Technical Staff (Model Quantization & Inference) employer: Lamb Labs

Lamb Labs provides a unique opportunity for professionals to work on groundbreaking AI technologies in a collaborative and research-focused environment. The company's commitment to innovation and efficiency in AI inference makes it an attractive employer for those looking to advance their careers in this exciting field.

L

Contact Details:

Lamb Labs Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Member of Technical Staff (Model Quantization & Inference)

✨Join Local Tech Meetups

Get out there and mingle with fellow developers by joining local tech meetups. It’s a fantastic way to meet people who might be working at Lamb Labs or know someone who does. Plus, you can pick up some trendy tech skills and trends while you're at it!

✨Contribute to Open Source Projects

Show off your coding chops by jumping into open-source projects. Not only does this give you practical experience, but it also gets you noticed in the dev community. You'll create a killer portfolio that speaks volumes about your skills to Lamb Labs.

✨Tap into Online Developer Communities

Don’t underestimate the power of online developer communities like GitHub, Stack Overflow, and even Reddit. Participate in discussions, share your projects, and build your visibility. We can often find opportunities through these channels that can lead to a full-time gig at companies like Lamb Labs.

✨Explore Job Boards Specifically for Tech Roles

Keep your eyes peeled on job boards that focus on tech roles. Sites like TechCareers or Stack Overflow Jobs can often have listings for companies like Lamb Labs that might not show up on broader job sites. Make it a habit to check these regularly, and don’t hesitate to apply directly through our website!

We think you need these skills to ace Member of Technical Staff (Model Quantization & Inference)

Deep understanding of transformer-based language models
Model quantization techniques
Low-precision numerical computation
Experience with sub-4-bit models
Knowledge of weight and activation distributions
Quantization error analysis
Strong Python skills

Some tips for your application 🫡

Show off your coding skills:When applying for a software engineering role, it's super important to showcase your coding skills. Make sure your CV includes your tech stack, any relevant programming languages you’re comfortable with, and examples of projects you've worked on. If you have a GitHub profile, link it up! We love to see code in action.

Tailor your portfolio:For a full-time role, we’d expect to see some solid examples of your work in your portfolio. Make sure to include at least two or three projects that highlight your problem-solving skills and your ability to work with different technologies. Focus on the projects that are most relevant to the position at Lamb Labs.

Craft a killer cover letter:Your cover letter is your chance to stand out—make it personal! Explain why you want to work at Lamb Labs and how your skills align with the role. Show us your passion for software development. We dig enthusiastic candidates who understand the value of collaboration and continuous learning!

Be clear and concise:When it comes to writing your CV and cover letter, clarity is key. Avoid jargon that could confuse us and stick to simple, direct language. Highlight your achievements with quantifiable results where possible, and keep everything easy to read. A well-organised application goes a long way!

How to prepare for a job interview at Lamb Labs

✨Brush Up on Your Coding Skills

For a full-time software engineering role, it's crucial that we stay sharp with our coding abilities. Expect technical questions that might involve solving problems on the spot or discussing algorithms. Practise on platforms like LeetCode or HackerRank to get comfortable with the types of questions that often come up.

✨Know Your Tools and Frameworks

Make sure we’re well-acquainted with the tools and technologies listed in the job description. Familiarise ourselves with any specific frameworks or programming languages mentioned. If Lamb Labs uses React or Node.js, for instance, be ready to discuss how we’ve used them in previous projects or coursework.

✨Showcase Your Projects

Bring along a portfolio that highlights our best work. This could be code samples, GitHub repositories, or any side projects we’ve built. Make sure we can talk through our thought process for each project, especially the challenges we faced and how we solved them—this shows our problem-solving skills in action.

✨Prepare for Behavioural Questions

While technical skills are key, full-time positions also require cultural fit. Be ready to discuss our previous experiences and how we handle teamwork, conflict, and deadlines. Brush up on the STAR method—Situation, Task, Action, Result—to clearly articulate our past experiences when discussing how we've contributed to a team.