4054dca1-a4f AI Inference Engineer We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

What you'll do

Develop APIs for AI inference that will be used by both internal and external customers.

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

What you need

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

Why this matters

As an AI Inference engineer, you will play a critical role in the development and deployment of our machine learning models. Your work will have a direct impact on the performance and reliability of our systems, and will help us to continue to innovate and improve our products.

XML job scraping automation by YubHub

]]> full-time mid onsite Final offer amounts are determined by multiple factors, including, experience and expertise. ML systems, deep learning frameworks, GPU architectures, LLM architectures, inference optimization techniques Engineering Technology Perplexity https://logos.yubhub.co/perplexity.com.png Perplexity is a company that is looking for an AI Inference engineer to join their growing team. They are a technology company that is working on large-scale deployment of machine learning models for real-time inference. https://jobs.ashbyhq.com https://jobs.ashbyhq.com/perplexity/e4777627-ff8f-4257-8612-3a016bb58592 London 2026-03-04 e37be4c0-4be AI Inference Engineer Perplexity is looking for an AI Inference Engineer to join their team. The successful candidate will be responsible for developing APIs for AI inference, benchmarking and addressing bottlenecks throughout the inference stack, improving the reliability and observability of systems, and exploring novel research and implementing LLM inference optimisations.

What you'll do

As an AI Inference Engineer at Perplexity, you will have the opportunity to work on large-scale deployment of machine learning models for real-time inference. You will be responsible for developing APIs for AI inference that will be used by both internal and external customers.

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimisations

What you need

To be successful in this role, you will need to have experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX), familiarity with common LLM architectures and inference optimisation techniques (e.g. continuous batching, quantisation, etc.), and understanding of GPU architectures or experience with GPU kernel programming using CUDA.

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimisation techniques (e.g. continuous batching, quantisation, etc.)
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

XML job scraping automation by YubHub

]]> full-time mid onsite $220K – $405K ML systems, deep learning frameworks, LLM architectures, inference optimisation techniques, GPU architectures, GPU kernel programming, continuous batching, quantisation, PyTorch, TensorFlow, ONNX Engineering Technology Perplexity https://logos.yubhub.co/perplexity.ai.png Perplexity is a cutting-edge technology company that specialises in artificial intelligence and machine learning. They are looking for talented individuals to join their team and contribute to the development of their AI products. https://www.perplexity.ai/ https://jobs.ashbyhq.com/perplexity/8a976851-9bef-4b07-8d36-567fa9540aef San Francisco, New York City, Palo Alto 2026-03-04