{"version":"0.1","company":{"name":"YubHub","url":"https://yubhub.co","jobsUrl":"https://yubhub.co/jobs/skill/sensitive-content"},"x-facet":{"type":"skill","slug":"sensitive-content","display":"Sensitive Content","count":2},"x-feed-size-limit":100,"x-feed-sort":"enriched_at desc","x-feed-notice":"This feed contains at most 100 jobs (the most recently enriched). For the full corpus, use the paginated /stats/by-facet endpoint or /search.","x-generator":"yubhub-xml-generator","x-rights":"Free to redistribute with attribution: \"Data by YubHub (https://yubhub.co)\"","x-schema":"Each entry in `jobs` follows https://schema.org/JobPosting. YubHub-native raw fields carry `x-` prefix.","jobs":[{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_e03253e3-c7f"},"title":"Safeguards Analyst, Human Exploitation & Abuse","description":"<p>As a Safeguards Analyst focusing on human exploitation and abuse, you will be responsible for building and executing enforcement workflows that detect and mitigate the use of our products to facilitate human trafficking, sextortion, image-based sexual abuse, bullying, and harassment.</p>\n<p>You will be a member of the user well-being team, and your initial focus will be on standing up detection, review, and escalation workflows for this domain , from tuning classifiers and curating evaluation datasets through to managing external partnerships and real-world harm escalation pathways.</p>\n<p>This position may later expand to include broader areas of user well-being enforcement. Safety is core to our mission, and you&#39;ll help shape policy enforcement so that our users can interact with and build on top of our products across all surfaces in a harmless, helpful, and honest way.</p>\n<p>In this position, you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.</p>\n<p><strong>Responsibilities:</strong></p>\n<ul>\n<li>Design and architect automated enforcement systems and review workflows for human exploitation and abuse, ensuring they scale effectively while maintaining high accuracy</li>\n</ul>\n<ul>\n<li>Partner with Product, Engineering, and Data Science teams to build and tune detection signals for human trafficking, sextortion, and image-based sexual abuse, and to develop custom mitigations for these sensitive policy areas</li>\n</ul>\n<ul>\n<li>Curate policy violation examples, maintain golden evaluation datasets, and track enforcement actions across both consumer and API surfaces</li>\n</ul>\n<ul>\n<li>Conduct deep-dive investigations into suspected exploitation activity , using SQL and other data analysis tools to surface threat patterns and bad-actor behavior in large datasets , then produce clear, well-sourced intelligence reports that inform detection strategy and surface policy gaps to the Safeguards policy design team</li>\n</ul>\n<ul>\n<li>Study trends internally and in the broader ecosystem , including evolving trafficking and sextortion tactics , to anticipate how AI systems could be misused for exploitation as capabilities advance</li>\n</ul>\n<ul>\n<li>Review and investigate flagged content to drive enforcement decisions and policy improvements, exercising careful judgment on the line between permitted adult content and exploitative material</li>\n</ul>\n<ul>\n<li>Build and maintain relationships with external intelligence partners , including hotlines, NGOs, and industry hash-sharing consortia , to inform our approach and enable appropriate real-world escalation</li>\n</ul>\n<p><strong>Requirements:</strong></p>\n<ul>\n<li>3+ years of experience in trust and safety, content moderation, counter-exploitation work, or a related field</li>\n</ul>\n<ul>\n<li>Subject matter expertise in one or more of: human trafficking, human exploitation and abuse, sextortion, image-based sexual abuse / non-consensual intimate imagery, or commercial sexual exploitation</li>\n</ul>\n<ul>\n<li>Experience building or operating detection and review workflows for sensitive content, at a platform, NGO, hotline, or similar organization</li>\n</ul>\n<ul>\n<li>Ability to use SQL, Python, and/or other data analysis tools to interact with large datasets and derive insights that support key decisions and recommendations</li>\n</ul>\n<ul>\n<li>Demonstrated ability to analyze complex situations and make well-reasoned decisions under pressure</li>\n</ul>\n<ul>\n<li>Sound judgment in distinguishing permitted content from exploitative content, and comfort working in areas where these lines require careful reasoning</li>\n</ul>\n<ul>\n<li>Strong attention to detail and ability to maintain accurate documentation</li>\n</ul>\n<ul>\n<li>Ability to collaborate with team members while navigating rapidly evolving priorities and workstreams</li>\n</ul>\n<p><strong>Preferred Qualifications:</strong></p>\n<ul>\n<li>Familiarity with the NGO and industry ecosystem working on these harms (for example, Polaris Project, Thorn, NCMEC, IWF, StopNCII, or industry hash-sharing initiatives)</li>\n</ul>\n<ul>\n<li>Experience conducting open-source investigations or threat actor profiling in a trust &amp; safety, intelligence, or law enforcement context</li>\n</ul>\n<ul>\n<li>Experience working with generative AI products, including writing effective prompts for content review and enforcement</li>\n</ul>\n<ul>\n<li>A deep interest in AI safety and responsible technology development</li>\n</ul>\n<ul>\n<li>Experience standing up real-world harm escalation pathways or working with law enforcement referral processes</li>\n</ul>\n<p><strong>Compensation:</strong></p>\n<p>The annual compensation range for this role is $245,000-$285,000 USD.</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_e03253e3-c7f","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Anthropic","sameAs":"https://www.anthropic.com/","logo":"https://logos.yubhub.co/anthropic.com.png"},"x-apply-url":"https://job-boards.greenhouse.io/anthropic/jobs/5156333008","x-work-arrangement":"remote-hybrid","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$245,000-$285,000 USD","x-skills-required":["trust and safety","content moderation","counter-exploitation work","SQL","Python","data analysis","detection and review workflows","sensitive content","human trafficking","human exploitation and abuse","sextortion","image-based sexual abuse","commercial sexual exploitation"],"x-skills-preferred":["NGO and industry ecosystem","open-source investigations","threat actor profiling","generative AI products","AI safety and responsible technology development","real-world harm escalation pathways"],"datePosted":"2026-04-18T15:45:00.507Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Remote-Friendly, United States"}},"jobLocationType":"TELECOMMUTE","employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"trust and safety, content moderation, counter-exploitation work, SQL, Python, data analysis, detection and review workflows, sensitive content, human trafficking, human exploitation and abuse, sextortion, image-based sexual abuse, commercial sexual exploitation, NGO and industry ecosystem, open-source investigations, threat actor profiling, generative AI products, AI safety and responsible technology development, real-world harm escalation pathways","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":245000,"maxValue":285000,"unitText":"YEAR"}}},{"@context":"https://schema.org","@type":"JobPosting","identifier":{"@type":"PropertyValue","name":"YubHub","value":"job_0b51f695-3f8"},"title":"Trust & Safety Operations Analyst","description":"<p><strong>Job Posting</strong></p>\n<p><strong>Trust &amp; Safety Operations Analyst</strong></p>\n<p><strong>Location</strong></p>\n<p>San Francisco</p>\n<p><strong>Employment Type</strong></p>\n<p>Full time</p>\n<p><strong>Department</strong></p>\n<p><strong>Compensation</strong></p>\n<ul>\n<li>$189K – $280K • Offers Equity</li>\n</ul>\n<p>The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.</p>\n<ul>\n<li>Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts</li>\n</ul>\n<ul>\n<li>Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)</li>\n</ul>\n<ul>\n<li>401(k) retirement plan with employer match</li>\n</ul>\n<ul>\n<li>Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)</li>\n</ul>\n<ul>\n<li>Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees</li>\n</ul>\n<ul>\n<li>13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)</li>\n</ul>\n<ul>\n<li>Mental health and wellness support</li>\n</ul>\n<ul>\n<li>Employer-paid basic life and disability coverage</li>\n</ul>\n<ul>\n<li>Annual learning and development stipend to fuel your professional growth</li>\n</ul>\n<ul>\n<li>Daily meals in our offices, and meal delivery credits as eligible</li>\n</ul>\n<ul>\n<li>Relocation support for eligible employees</li>\n</ul>\n<ul>\n<li>Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.</li>\n</ul>\n<p>More details about our benefits are available to candidates during the hiring process.</p>\n<p>This role is at-will and OpenAI reserves the right to modify base pay and other compensation components at any time based on individual performance, team or company results, or market conditions.</p>\n<p><strong><strong>About the Team</strong></strong></p>\n<p>At OpenAI, our Trust, Safety &amp; Risk Operations teams safeguard our products, users, and the company from abuse, fraud, scams, regulatory non-compliance, and other emerging risks. We operate at the intersection of operations, compliance, user trust, and safety working closely with Legal, Policy, Engineering, Product, Go-To-Market, and external partners to ensure our platforms are safe, compliant, and trusted by a diverse, global user base.</p>\n<p>We support users across ChatGPT, our API, enterprise offerings, and developer tools handling sensitive inbound cases, building detection and enforcement systems, and scaling operational processes to meet the demands of a fast-moving, high-stakes environment.</p>\n<p><strong><strong>About the Role</strong></strong></p>\n<p>We are seeking experienced, senior-level analysts who specialize in one or more of the following areas:</p>\n<ul>\n<li><strong>Content Integrity &amp; Scaled Enforcement</strong> – Detecting, reviewing, and acting on policy violations, harmful content, and emerging abuse patterns at scale.</li>\n</ul>\n<ul>\n<li><strong>Emerging Risk Operations</strong> – Identifying, triaging, and mitigating new and complex safety, policy, or integrity challenges in a rapidly evolving AI landscape.</li>\n</ul>\n<p>In this role, you will own high-sensitivity workflows, act as an incident manager for complex cases, and build scalable operational systems; including tooling, automation, and vendor processes that reinforce user safety and trust while meeting our legal, ethical, and product obligations.</p>\n<p>We use a hybrid work model of 3 days in the San Francisco office per week and offer relocation assistance to new employees.</p>\n<p>Please note: This role may involve exposure to sensitive content, including material that is sexual, violent, or otherwise disturbing.</p>\n<p><strong>In This Role, You Will:</strong></p>\n<ul>\n<li>Handle and resolve high-priority cases in your area of specialization (scaled content enforcement, fraud/scams, privacy/regulatory, or emerging risks).</li>\n</ul>\n<ul>\n<li>Perform in-depth risk evaluations and investigations using internal tools, product signals, and third-party data.</li>\n</ul>\n<ul>\n<li>Act as incident manager for escalations requiring nuanced policy, legal, or regulatory interpretation.</li>\n</ul>\n<ul>\n<li>Partner with cross-functional teams to design and implement world-class operational workflows, decision trees, and automation strategies.</li>\n</ul>\n<ul>\n<li>Build feedback loops from casework to inform product, engineering, and policy improvements.</li>\n</ul>\n<ul>\n<li>Develop and maintain playbooks, SOPs, macros, and knowledge resources for internal teams and vendors.</li>\n</ul>\n<ul>\n<li>Lead or contribute to cross-functional projects, from zero-to-one process builds to global operational scale-ups.</li>\n</ul>\n<ul>\n<li>Monitor operational health through case quality audits, SLA adherence, escalation accuracy, and user satisfaction metrics.</li>\n</ul>\n<ul>\n<li>Train and support vendor teams, ensuring consistent quality and alignment with OpenAI’s trust and safety standards.</li>\n</ul>\n<p><strong>You Might Thrive in This Role If You:</strong></p>\n<ul>\n<li>Have 5+ years of experience in one or more of: trust &amp; safety, fraud prevention, scam investigation, privacy/legal operations, compliance, or other risk/integrity domains ideally in a global or high-growth tech environment.</li>\n</ul>\n<ul>\n<li>Leverage OpenAI technology to enhance workflows, improve decision-making, and scale operational impact.</li>\n</ul>\n<ul>\n<li>Bring deep domain expertise in your specialization area and familiarity with relevant legal, policy, and technical frameworks.</li>\n</ul>\n<ul>\n<li>Have a track record of scaling operations, building processes, and working cross-functionally to improve performance and safety outcomes.</li>\n</ul>\n<ul>\n<li>Possess exceptional analytical skills able to detect patterns, assess risk, and recommend policy or product changes based on evidence.</li>\n</ul>\n<ul>\n<li>Communicate with clarity, empathy, and precision especially in sensitive user-facing contexts.</li>\n</ul>\n<ul>\n<li>Thrive in ambiguous, high-autonomy environments and balance speed with diligence.</li>\n</ul>\n<p>Are comfortable with frequent context switching, managing multiple projects, and prioritizing impact.</p>\n<p><strong><strong>What We Offer</strong></strong></p>\n<ul>\n<li>Competitive salary and equity package</li>\n</ul>\n<ul>\n<li>Comprehensive benefits, including medical, dental, and vision insurance</li>\n</ul>\n<ul>\n<li>401(k) retirement plan with employer match</li>\n</ul>\n<ul>\n<li>Paid parental leave and medical and caregiver leave</li>\n</ul>\n<ul>\n<li>Flexible PTO and paid company holidays</li>\n</ul>\n<ul>\n<li>Mental health and wellness support</li>\n</ul>\n<ul>\n<li>Annual learning and development stipend</li>\n</ul>\n<ul>\n<li>Daily meals in our offices and meal delivery credits</li>\n</ul>\n<ul>\n<li>Relocation support for eligible employees</li>\n</ul>\n<ul>\n<li>Additional taxable fringe benefits, such as charitable donation matching and wellness stipends</li>\n</ul>\n<p><strong><strong>How to Apply</strong></strong></p>\n<p>If you are a motivated and experienced professional looking to join a dynamic team, please submit your application, including your resume and a cover letter, to [insert contact information]. We look forward to hearing from you!</p>\n<p style=\"margin-top:24px;font-size:13px;color:#666;\">XML job scraping automation by <a href=\"https://yubhub.co\">YubHub</a></p>","url":"https://yubhub.co/jobs/job_0b51f695-3f8","directApply":true,"hiringOrganization":{"@type":"Organization","name":"OpenAI","sameAs":"https://jobs.ashbyhq.com","logo":"https://logos.yubhub.co/openai.com.png"},"x-apply-url":"https://jobs.ashbyhq.com/openai/eb54b316-26fb-498f-a68c-9990ff9c402c","x-work-arrangement":"hybrid","x-experience-level":"senior","x-job-type":"full-time","x-salary-range":"$189K – $280K","x-skills-required":["trust & safety","fraud prevention","scam investigation","privacy/legal operations","compliance","risk/integrity domains","OpenAI technology","workflow management","decision-making","operational impact","domain expertise","legal","policy","technical frameworks","analytical skills","pattern detection","risk assessment","policy/product changes","communication","clarity","empathy","precision","user-facing contexts","ambiguous environments","high-autonomy","speed","diligence","context switching","project management","prioritization"],"x-skills-preferred":["ChatGPT","API","enterprise offerings","developer tools","sensitive content","sexual","violent","disturbing","hybrid work model","relocation assistance","vendor management","quality control","alignment","OpenAI’s trust and safety standards"],"datePosted":"2026-03-06T18:34:54.778Z","jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Francisco"}},"employmentType":"FULL_TIME","occupationalCategory":"Engineering","industry":"Technology","skills":"trust & safety, fraud prevention, scam investigation, privacy/legal operations, compliance, risk/integrity domains, OpenAI technology, workflow management, decision-making, operational impact, domain expertise, legal, policy, technical frameworks, analytical skills, pattern detection, risk assessment, policy/product changes, communication, clarity, empathy, precision, user-facing contexts, ambiguous environments, high-autonomy, speed, diligence, context switching, project management, prioritization, ChatGPT, API, enterprise offerings, developer tools, sensitive content, sexual, violent, disturbing, hybrid work model, relocation assistance, vendor management, quality control, alignment, OpenAI’s trust and safety standards","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":189000,"maxValue":280000,"unitText":"YEAR"}}}]}