ML Engineer (LLM)

Machine Learning / LLM Engineer

About Oh:

Oh is pioneering hyper-realistic, uncensored AI-driven content, building a full-spectrum ecosystem of multimodal AI products. Our platform powers lifelike digital twins and AI characters across text, voice, and images.

With a mission to become the OpenAI of the spicy content industry, we iterate fast, push boundaries, and deploy cutting-edge, real-time conversational AI experiences at scale.

The Role:

Our platform integrates a variety of multimodal GenAI models. You will own the technical roadmap and full lifecycle of our large language models, most notably our flagship Llama 3.1 70B and other open-source models.

Your responsibilities will include:

• Fine-tuning with custom and synthetic datasets
• Deploying on GPU platforms to ensure low-latency, cost-efficient, and safe real-time interactions
• Driving multimodal expansion—integrating text, voice, and image capabilities
• Embedding robust safety and compliance measures
• Keeping on top of recent development in the field and auditing new models for a wide range of purposes (e.g. conversational AI, intent classification, AI agents life planner)

Key Responsibilities:

🔹 LLM Fine-Tuning & Optimization

• Fine-tune and optimize models (Llama 3.1 70B, GPT-based, Mistral, etc.) using domain-specific and synthetic datasets
• Enhance accuracy, reduce hallucinations, and improve alignment with user intent

🔹 Deployment & Infrastructure Management

• Deploy scalable, memory-efficient models on GPU-based platforms (Runpod, AWS, Kubernetes clusters)
• Optimize GPU inference with Torch, CUDA, TensorRT, vLLM, and DeepSpeed

🔹 Multimodal & Cross-Model Integration

• Integrate additional open-source models to enable image prompt generation, voice synthesis, and dynamic character personalization
• Expand multimodal AI capabilities (e.g. improve LLava-based vision models)

🔹 Data Pipeline & Evaluation

• Design robust data pipelines for curation, cleaning, synthetic data generation, and versioning (DVC)
• Implement evaluation metrics and continuous monitoring to ensure model quality

🔹 Real-Time Performance & System Optimization

• Ensure low-latency, real-time performance using mixed-precision training, quantization, pruning, and distillation techniques

🔹 Safety, Moderation & Compliance

• Embed robust safety, content moderation, and ethical AI frameworks to comply with GDPR and industry standards
• Develop custom token filters and controlled response mechanisms

🔹 Monitoring, Diagnostics & Cost Management

• Set up and maintain monitoring tools (Prometheus, Grafana, TensorBoard, Weights & Biases, Sentry) for performance tracking and cost optimization

Technical Skills & Requirements:

🔹 Experience:

• 5+ years in machine learning engineering, NLP, or AI research with deep expertise in Transformer-based LLMs

🔹 Programming & Frameworks:

• Strong proficiency in Python and Bash scripting
• Hands-on experience with PyTorch, HuggingFace libraries (Transformers, Diffusers, PEFT, Accelerate), and the common ML toolkit (e.g. SKLearn, Pandas, Numpy)
• Familiarity with JAX/TensorFlow is a plus

🔹 LLM Specialization:

• Proven expertise in fine-tuning LLMs using techniques like LoRA, QLoRA, PEFT, RLHF, and prompt engineering

🔹 GPU & Inference Optimization:

• Experience with common inference speed optimisation and model quantization techniques.

🔹 Deployment & Orchestration:

• Skilled in containerization (Docker) and orchestration (Kubernetes) for scalable ML deployments
• Experience with major MLOps frameworks (MLFlow / KubeFlow) preferred

🔹 Data Handling:

• Proficient in data wrangling and preprocessing (Pandas, Dask)
• Experience managing large-scale datasets using AWS (S3, RedShift, EC2)
• Knowledge of data QC and monitoring tools (DVC, Great Expectations)

🔹 Additional Knowledge:

• Understanding of retrieval-augmented generation (RAG) techniques
• Familiarity with vector databases (FAISS, Pinecone, Weaviate)

Preferred Qualifications:

✅ Experience integrating and optimizing multimodal models (text, voice, image, video)

✅ Background in AI-driven gaming, digital experiences, or adult content

✅ Familiarity with CI/CD pipelines (GitLab CI, Jenkins) for ML workflows

✅ Interest or experience in crypto, Web3, or NFT-based AI models

✅ Prior exposure to AI governance, safety, or ethical AI frameworks

What We Offer:

💰 Competitive Compensation:

• Attractive salary, benefits, and equity participation

🌍 Remote & Flexible:

• Remote-first work environment with flexible hours

🚀 Growth & Leadership:

• Rapid career advancement and the opportunity to shape our AI strategy

🔥 Innovative Culture:

• Join a fast-paced team at the forefront of advanced, uncensored AI applications

If you’re passionate about pushing the boundaries of AI-driven experiences and have a track record in developing, deploying, and optimizing cutting-edge LLMs, we want to hear from you! 🚀