{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/skill/high-throughput-distributed-systems"},"x-facet":{"type":"skill","slug":"high-throughput-distributed-systems","display":"high-throughput distributed systems","count":1},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_e5554df1-95d"},"title":"Software Engineer","description":"<p><strong>About the Role</strong></p>\n<p>As a Software Engineer on the Model Routing &amp; Inference team at Cursor, you&#39;ll build the inference platform that powers every AI interaction in the product.</p>\n<p>This team owns the full inference path: making Cursor&#39;s AI faster, more reliable, and more cost-effective at a scale few teams in the world get to operate at. Every agent session, every tab completion, and every chat message flows through your stack.</p>\n<p><strong>Example Projects Include...</strong></p>\n<ul>\n<li>Building and evolving our inference gateway, a single abstraction over every provider&#39;s API semantics, so model onboarding becomes a config change.</li>\n<li>Designing intelligent cross-provider failover so no single provider outage causes user-visible degradation.</li>\n<li>Designing routing backpressure and admission control so traffic spikes don&#39;t cascade into providers.</li>\n</ul>\n<p><strong>You May Be a Fit If...</strong></p>\n<ul>\n<li>You have deep experience building high-throughput, low-latency distributed systems, especially in inference serving, traffic routing, or real-time data pipelines.</li>\n<li>You&#39;re comfortable reasoning about cost/performance tradeoffs at scale (GPU utilization, provider economics, capacity planning).</li>\n<li>You have strong software engineering fundamentals and enjoy shipping production systems that handle millions of requests.</li>\n<li>You make good calls in the gray area: weighing reliability, cost, latency, and user experience when there isn&#39;t a single &#39;right&#39; answer.</li>\n</ul>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_e5554df1-95d","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Cursor","sameAs":"https://cursor.com","logo":"https://logos.yubhub.co/cursor.com.png"},"x-apply-url":"https://cursor.com/careers/software-engineer-model-routing-inference?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply","x-work-arrangement":"remote","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":null,"x-skills-required":["high-throughput distributed systems","inference serving","traffic routing","real-time data pipelines","cost/performance tradeoffs"],"x-skills-preferred":[],"datePosted":"2026-04-24T14:17:45.329Z","jobLocationType":"TELECOMMUTE","employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"high-throughput distributed systems, inference serving, traffic routing, real-time data pipelines, cost/performance tradeoffs"}]}