As a Software Engineer on the Model Routing & Inference team at Cursor, you'll build the inference platform that powers every AI interaction in the product.

This team owns the full inference path: making Cursor's AI faster, more reliable, and more cost-effective at a scale few teams in the world get to operate at. Every agent session, every tab completion, and every chat message flows through your stack.

Example Projects Include...

• Building and evolving our inference gateway, a single abstraction over every provider's API semantics, so model onboarding becomes a config change.
• Designing intelligent cross-provider failover so no single provider outage causes user-visible degradation.
• Designing routing backpressure and admission control so traffic spikes don't cascade into providers.

You May Be a Fit If...

• You have deep experience building high-throughput, low-latency distributed systems, especially in inference serving, traffic routing, or real-time data pipelines.
• You're comfortable reasoning about cost/performance tradeoffs at scale (GPU utilization, provider economics, capacity planning).
• You have strong software engineering fundamentals and enjoy shipping production systems that handle millions of requests.
• You make good calls in the gray area: weighing reliability, cost, latency, and user experience when there isn't a single 'right' answer.

XML job scraping automation by YubHub

Key responsibilities include creating and driving engineering agendas to advance multimodal capabilities, improving data quality through annotation, filtering, augmentation, synthetic generation, captioning, and in-depth data studies, designing evaluation frameworks, metrics, benchmarks, evals, and reward models tailored to image/video/audio quality and coherence, implementing efficient algorithms for state-of-the-art model performance, and developing scalable data collection and processing pipelines for multimodal (primarily image/video-focused) datasets.

The ideal candidate will have a track record in leading studies that significantly improve neural network capabilities and performance through better data or modeling, experience in data-driven experiment designs, systematic analysis, and iterative model debugging, experience developing or working with large-scale distributed machine learning systems, and ability to deliver optimal end-to-end user experiences.

XML job scraping automation by YubHub

The Imagine Product team is redefining AI-driven media experiences for Grok users worldwide. You'll build and scale robust, high-performance systems that power immersive, multi-modal media interactions,leveraging cutting-edge AI to enable seamless generation, processing, and delivery of images, video, audio, and beyond.

Your work will drive engaging, real-time user experiences that captivate and delight millions, turning advanced multimodal models into production-grade features. If you're a driven problem-solver passionate about AI, media technologies, and creating scalable solutions that shape the future of consumer AI, this is your opportunity to make a lasting impact.

Responsibilities

• Design and implement scalable systems to support Grok's AI-driven media experiences, ensuring high performance, reliability, and low-latency at global scale.
• Architect robust infrastructure for real-time multi-modal interactions, including handling generation requests, media processing, and seamless integration with frontend and model serving layers.
• Build and optimise large-scale data pipelines to ingest, process, and analyse multi-modal data (images, video, audio), fueling continuous improvement and personalisation of Grok's media capabilities.
• Collaborate closely with frontend engineers, AI researchers, and product teams to deliver captivating, media-rich features and end-to-end user experiences.
• Own full-cycle development of solutions: from system design and prototyping to deployment, monitoring, observability, and iterative refinement.
• Deliver production-ready, maintainable code that powers features reaching hundreds of millions of users.

Basic Qualifications

• Proficiency in Python or Rust, with a strong track record of writing clean, efficient, maintainable, and scalable code.
• Experience designing and building systems for consumer-facing products, with emphasis on performance, reliability, and handling high-throughput workloads.
• Hands-on expertise in large-scale data infrastructure and pipelines, particularly for multi-modal or media-heavy AI applications.
• Proven ability to deliver robust, production-grade solutions to millions of users while maintaining high standards of quality and uptime.
• Strong problem-solving skills and a passion for turning innovative ideas into high-impact, scalable realities.
• Deep enthusiasm for AI and media technologies, with a commitment to building user-focused products that inspire and engage.

Preferred Skills and Experience

• Experience with real-time systems, inference serving, or multi-modal data processing at scale.
• Familiarity with distributed systems, containerisation (e.g., Kubernetes), observability tools, or performance tuning for AI workloads.
• Background in AI-driven consumer products or media generation technologies.
• Track record collaborating across engineering, research, and product teams to ship delightful features quickly.

Compensation and Benefits

$180,000 - $440,000 USD

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

XML job scraping automation by YubHub