AI Inference Engineer

AI Inference Engineer

We are seeking an AI Inference Engineer to join our expanding team. Our current technology stack includes Python, C++, TensorRT-LLM, and Kubernetes. This role offers the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

• Develop APIs for AI inference used by internal and external customers
• Benchmark and optimize the inference stack to address bottlenecks
• Enhance system reliability and observability, and respond to outages
• Research and implement optimizations for LLM inference

Qualifications

• Experience with ML systems and deep learning frameworks (e.g., PyTorch, TensorFlow, ONNX)
• Knowledge of LLM architectures and inference techniques (e.g., batching, quantization)
• Experience deploying reliable, distributed, real-time model serving at scale
• (Optional) Understanding of GPU architectures or CUDA kernel programming

The compensation range for this role is $190,000 – $240,000. Additional benefits include equity, comprehensive health insurance, dental, vision, and a 401(k) plan.

#J-18808-Ljbffr