Lead AI Inference Engineer in London

Join Tether and shape the future of digital finance. At Tether, we’re not just building products; we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from exchanges and wallets to payment processors and ATMs—to seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain technology, Tether enables you to store, send, and receive digital tokens instantly, securely, and globally, all at a fraction of the cost. Transparency is the bedrock of everything we do, ensuring trust in every transaction.

Innovate with Tether:

• Tether Finance: Our innovative product suite features the world’s most trusted stablecoin, USDT, relied upon by hundreds of millions worldwide, alongside pioneering digital asset tokenization services.
• Tether Power: Driving sustainable growth, our energy solutions optimize excess power for Bitcoin mining using eco-friendly practices in state-of-the-art, geo-diverse facilities.
• Tether Data: Fueling breakthroughs in AI and peer-to-peer technology, we reduce infrastructure costs and enhance global communications with cutting-edge solutions like KEET, our flagship app that redefines secure and private data sharing.
• Tether Education: Democratizing access to top-tier digital learning, we empower individuals to thrive in the digital and gig economies, driving global growth and opportunity.
• Tether Evolution: At the intersection of technology and human potential, we are pushing the boundaries of what is possible, crafting a future where innovation and human capabilities merge in powerful, unprecedented ways.

Why join us? Our team is a global talent powerhouse, working remotely from every corner of the world. If you’re passionate about making a mark in the fintech space, this is your opportunity to collaborate with some of the brightest minds, pushing boundaries and setting new standards. We’ve grown fast, stayed lean, and secured our place as a leader in the industry. If you have excellent English communication skills and are ready to contribute to the most innovative platform on the planet, Tether is the place for you. Are you ready to be part of the future?

About the job: You will lead a cross-functional pod that spans the full stack, from C++ inference engines to JavaScript applications. Your responsibility is to ensure that local AI capabilities ship reliably and perform well across devices. You will balance hands-on technical work with team coordination, guiding foundation and middleware engineers toward shared goals. This role is ideal for someone who understands both the low-level challenges of edge AI and the product-facing needs of app developers, and wants to drive the delivery of cohesive, production-ready local AI systems.

Responsibilities:

• Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml, onnx.
• Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments.
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning.
• Manage a cross-functional team (pod) made of middleware (JS), foundation (C++), QA and documentation engineers to produce high-quality deliverables.
• Regularly assess, both qualitatively and quantitatively, our position in the market with regards to similar products or platforms.
• Leverage the expertise of technical architects to ensure robust architectural choices and code quality.
• Ensure stable releases by following precise internal release processes.

Requirements:

• Excellent programming skills in C++.
• Strong experience with Llama.cpp and ggml inference engines, which facilitates the deployment of models to specific GPU architectures.
• Good understanding of deep learning concepts and model architectures.
• Experience with transformers and LLMs.
• Demonstrated ability to rapidly assimilate new technologies and techniques.
• Experience managing a small, specialized, cross-functional team (pod) of 3-5 people.
• A genuine passion for building good products that improve people's lives.
• A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D.

Bonus points if:

• You have extensive experience with Javascript/Typescript.
• You have experience with AWS, containerization platforms, orchestration, and automated testing suites (Maestro, Appium).
• You understand the difficulties, nuances and importance of p2p technology.
• You have worked with MLC, TVM or similar frameworks.
• You have experience with Vulkan, CUDA.
• You have productionized models.

Important information for candidates: Recruitment scams have become increasingly common. To protect yourself, please keep the following in mind when applying for roles: Apply only through our official channels. We do not use third-party platforms or agencies for recruitment unless clearly stated. All open roles are listed on our official careers page. Verify the recruiter’s identity. All our recruiters have verified LinkedIn profiles. If you’re unsure, you can confirm their identity by checking their profile or contacting us through our website. Be cautious of unusual communication methods. We do not conduct interviews over WhatsApp, Telegram, or SMS. All communication is done through official company emails and platforms. Double-check email addresses. All communication from us will come from emails ending in @tether.to or @tether.io. We will never request payment or financial details. If someone asks for personal financial information or payment at any point during the hiring process, it is a scam. Please report it immediately. When in doubt, feel free to reach out through our official website.