{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/skill/agent-sdks"},"x-facet":{"type":"skill","slug":"agent-sdks","display":"Agent Sdks","count":2},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_af19433f-b93"},"title":"Backend Engineer - API","description":"<p><strong>About the Role</strong></p>\n<p>As a Backend Engineer - API at xAI, you will play a crucial role in building the xAI API that serves our models to developers worldwide. You will own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability, including model serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling.</p>\n<p><strong>Responsibilities</strong></p>\n<ul>\n<li>Build the xAI API that serves our models to developers worldwide</li>\n<li>Own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability, including model serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling</li>\n</ul>\n<p><strong>Basic Qualifications</strong></p>\n<ul>\n<li>Expert knowledge of either Rust or C++</li>\n<li>Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems</li>\n<li>Knowledge of service observability and reliability best practices</li>\n<li>Experience in operating commonly used databases such as PostgreSQL, Clickhouse, and MongoDB</li>\n</ul>\n<p><strong>Preferred Skills and Experience</strong></p>\n<ul>\n<li>Experience with LLM inference engines and serving frameworks (e.g., SGLang, TensorRT, vLLM)</li>\n<li>Experience designing or building with agent SDKs and agent orchestration frameworks</li>\n<li>Experience with Docker, Kubernetes, and containerized applications</li>\n<li>Expert knowledge of gRPC (unary, response streaming, bi-directional streaming, REST mapping)</li>\n</ul>\n<p><strong>Compensation and Benefits</strong></p>\n<p>$180,000 - $440,000 USD</p>\n<p>Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short &amp; long-term disability insurance, life insurance, and various other discounts and perks.</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_af19433f-b93","directApply":true,"hiringOrganization":{"@type":"Organization","name":"xAI","sameAs":"https://www.xai.com","logo":"https://logos.yubhub.co/xai.com.png"},"x-apply-url":"https://job-boards.greenhouse.io/xai/jobs/5119111007","x-work-arrangement":"onsite","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$180,000 - $440,000 USD","x-skills-required":["Rust","C++","Distributed Systems","Service Observability","Database Management"],"x-skills-preferred":["LLM Inference Engines","Agent SDKs","Docker","Kubernetes","gRPC"],"datePosted":"2026-04-24T17:03:55.171Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Palo Alto, CA"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"Rust, C++, Distributed Systems, Service Observability, Database Management, LLM Inference Engines, Agent SDKs, Docker, Kubernetes, gRPC","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":180000,"maxValue":440000,"unitText":"YEAR"}}},{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_7fbf551a-201"},"title":"Backend Engineer - API","description":"<p>As a Backend Engineer - API at xAI, you will play a key role in building the xAI API that serves our models to developers worldwide. You will own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability, including model serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling.</p>\n<p>You will have expert knowledge of either Rust or C++ and experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems. You will also have knowledge of service observability and reliability best practices, as well as experience in operating commonly used databases such as PostgreSQL, Clickhouse, and MongoDB.</p>\n<p>Preferred skills and experience include experience with LLM inference engines and serving frameworks, agent SDKs and agent orchestration frameworks, Docker, Kubernetes, and containerized applications, and expert knowledge of gRPC.</p>\n<p>In addition to a competitive base salary of $180,000 - $440,000 USD, you will receive equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short &amp; long-term disability insurance, life insurance, and various other discounts and perks.</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_7fbf551a-201","directApply":true,"hiringOrganization":{"@type":"Organization","name":"xAI","sameAs":"https://www.xai.com/","logo":"https://logos.yubhub.co/xai.com.png"},"x-apply-url":"https://job-boards.greenhouse.io/xai/jobs/5119111007","x-work-arrangement":"onsite","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$180,000 - $440,000 USD","x-skills-required":["Rust","C++","PostgreSQL","Clickhouse","MongoDB","gRPC"],"x-skills-preferred":["LLM inference engines","Serving frameworks","Agent SDKs","Agent orchestration frameworks","Docker","Kubernetes"],"datePosted":"2026-04-24T13:04:37.241Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Palo Alto, CA"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"Rust, C++, PostgreSQL, Clickhouse, MongoDB, gRPC, LLM inference engines, Serving frameworks, Agent SDKs, Agent orchestration frameworks, Docker, Kubernetes","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":180000,"maxValue":440000,"unitText":"YEAR"}}}]}