{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/skill/production-ai-behavior"},"x-facet":{"type":"skill","slug":"production-ai-behavior","display":"production AI behavior","count":1},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_956ba265-d67"},"title":"Senior Applied AI Engineer (Observability)","description":"<p>We&#39;re hiring a Senior Applied AI Engineer to join our AI Platform/Observability team. You will be responsible for building the foundation that makes AI systems trustworthy at scale. This is a backend-heavy, systems-focused role in a greenfield environment.</p>\n<p>Your starting point will be AI observability, evaluation, and production reliability. From there, your scope expands into broader platform ownership: agent systems, orchestration layers, and shared infrastructure. Observability is the entry point,not the end state.</p>\n<p>In this role, you will:</p>\n<ul>\n<li>Build the observability and reliability foundation for AI systems across Komodo (logging, tracing, evaluation pipelines, feedback loops)</li>\n<li>Define how the organization measures LLM performance and quality in production (hallucinations, drift, latency, failure modes)</li>\n<li>Ship production-grade AI systems that improve platform reliability, scalability, and performance</li>\n<li>Lead design and architecture for complex applied AI systems (multi-agent workflows, tool-calling systems, model pipelines)</li>\n<li>Establish evaluation frameworks and experimentation practices (A/B testing, offline + online evaluation)</li>\n</ul>\n<p>You will drive experimentation across the organization, set best practices, and integrate new AI techniques into Komodo’s broader engineering ecosystem.</p>\n<p>Additional responsibilities include:</p>\n<ul>\n<li>Contributing to reusable infrastructure, patterns, and standards adopted across teams</li>\n<li>Partnering with product, data, and platform teams to shape AI-driven solutions</li>\n</ul>\n<p>We&#39;re looking for someone with strong expertise in LLMs and prompt systems, agent orchestration, and tool/function calling. You should have hands-on experience with AI observability, evaluation, or monitoring systems, debugging and improving production AI behavior, and strong backend engineering skills.</p>\n<p>As a Senior Applied AI Engineer, you will be part of a team that is shaping the future of healthcare intelligence. You will have the opportunity to work on cutting-edge projects, collaborate with experts in the field, and make a meaningful impact on the company&#39;s mission.</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_956ba265-d67","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Komodo Health","sameAs":"https://www.komodohealth.com/","logo":"https://logos.yubhub.co/komodohealth.com.png"},"x-apply-url":"https://job-boards.greenhouse.io/komodohealth/jobs/8512224002","x-work-arrangement":"hybrid","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$230,000-$270,000 USD","x-skills-required":["LLMs","prompt systems","agent orchestration","tool/function calling","AI observability","evaluation","monitoring systems","debugging","production AI behavior","backend engineering"],"x-skills-preferred":[],"datePosted":"2026-04-24T16:03:34.637Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Francisco, CA"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Healthcare","skills":"LLMs, prompt systems, agent orchestration, tool/function calling, AI observability, evaluation, monitoring systems, debugging, production AI behavior, backend engineering","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":230000,"maxValue":270000,"unitText":"YEAR"}}}]}