You will work at the intersection of AI safety and information integrity, combining deep expertise in influence operations with technical investigation skills to identify threat actors who leverage AI to generate synthetic content, amplify narratives, manipulate public discourse, or undermine democratic processes. Your work will directly shape how Anthropic defends against one of the most rapidly evolving categories of AI misuse.

Important context: In this position you may be exposed to explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays.

Responsibilities:

• Detect and investigate attempts to misuse Anthropic's AI systems for influence operations, including AI-generated disinformation, coordinated inauthentic behavior, astroturfing, and narrative manipulation campaigns

• Conduct technical investigations using SQL, Python, and other tools to analyze large datasets, trace user behavior patterns, and uncover coordinated networks of threat actors conducting influence operations

• Develop influence operation-specific detection capabilities, including abuse signals, behavioral clustering techniques, and detection methodologies tailored to AI-enabled information manipulation

• Create actionable intelligence reports on influence operation TTPs, emerging narrative threats, and threat actor campaigns leveraging AI systems

• Conduct cross-platform threat analysis linking on-platform activity to broader influence campaigns across social media, messaging platforms, and other digital ecosystems

• Monitor and analyze state-sponsored and non-state influence operations that may leverage AI capabilities, with particular focus on operations originating from or targeting geopolitically significant regions

• Collaborate with policy and enforcement teams to make informed decisions about user violations and ensure appropriate mitigation actions

• Engage with external stakeholders including government agencies, platform integrity teams, academic researchers, and threat intelligence sharing communities

• Forecast how advances in AI technology,including improved content generation, voice synthesis, and multimodal capabilities,will reshape the influence operations landscape and inform safety-by-design strategies

You may be a good fit if you:

• Have deep subject matter expertise in influence operations, coordinated inauthentic behavior, disinformation, or information warfare

• Have demonstrated proficiency in SQL and Python for data analysis and threat detection

• Have experience tracking and attributing influence campaigns to specific threat actors, including state-sponsored operations

• Have hands-on experience with large language models and understanding of how AI technology could be weaponized for influence operations

• Have experience with open-source intelligence (OSINT) methodologies and tools for investigating online information ecosystems

• Have excellent stakeholder management skills and ability to work with diverse teams including researchers, policy experts, legal teams, and external partners

• Can present analytical work to both technical and non-technical audiences, including government stakeholders and senior leadership

Strong candidates may also have:

• Experience at a major technology platform working on influence operations, platform integrity, or content authenticity

• Background in intelligence analysis, information operations, or counter-disinformation within government or military contexts

• Experience investigating operations linked to Chinese, Russian, Iranian, or other state-sponsored information campaigns

• Fluency in Mandarin Chinese, Russian, Farsi, and/or Arabic (speaking, reading, and writing) combined with a nuanced understanding of the geopolitical landscape and cultural context of the respective regions

• Familiarity with social network analysis techniques and tools for mapping coordinated behavior

• Background in AI safety, machine learning security, or technology abuse investigation

• Experience building and scaling threat detection systems or abuse monitoring programs

• Active Top Secret security clearance

The annual compensation range for this role is $230,000-$290,000 USD.

XML job scraping automation by YubHub

The vendors and partners you'll manage span verification, threat intelligence, process outsourcing, capability evaluation, civil society consultation, and research collaboration. You'll build repeatable processes where they're needed while staying nimble enough to handle novel partnership structures, like research collaborations, civil society consultations, and model red-teaming engagements that don't fit neatly into standard procurement workflows.

You'll work closely with legal, procurement, finance, and engineering teams, and you'll be the person who knows where every Safeguards contract stands, what we're spending, and where we should consider a change.

This is a role for someone who's comfortable operating across commercial, legal, and technical contexts in a fast-moving environment , someone who can negotiate contract terms, work with legal teams to redline contracts, set up model access for a research partner, and handle a vendor performance issue in one day.

*Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature.

Responsibilities:

Vendor Selection & Onboarding - Understand the broad vendor landscape for Safeguards and drive vendor selection processes with expert input, factoring in tradeoffs between capability, price, and internal resources across categories including verification, threat intelligence, process outsourcing, and capability evaluation

Conduct vendor due diligence and coordinate security and data governance reviews for vendors handling sensitive model access or content

Forecast future partnership needs and proactively research vendors and partners that could meet emerging Safeguards requirements

Contract & Budget Management - Manage contracts across the Safeguards vendor and partner portfolio, working with legal and procurement teams on contract redlining, negotiation, and execution

Work with legal teams and potential research partners to develop novel agreements for research collaboration, civil society consultation, and model red-teaming

Handle invoicing, payment, and renewal processes with partners

Own Safeguards vendor budget tracking and planning in partnership with finance teams, maintaining a clear picture of current spend and forecasting future needs

Ongoing Vendor & Partner Management - Manage vendor and researcher access to models and products during testing phases and trials

Oversee and monitor vendor performance and usage, flagging issues and resolving concerns and disputes as they arise

Report on vendor performance, spend, and contract status to Safeguards leadership

You may be a good fit if you have:

5+ years in vendor management, procurement, or contract operations, ideally in risk, fraud, compliance, or trust & safety contexts at a technology company

Demonstrated experience reviewing and negotiating contracts, including comfort with redlining and working alongside legal counsel

Track record managing vendor budgets, including forecasting, tracking spend, and making tradeoff recommendations

Understanding of AI safety, account abuse, or platform integrity issues , you know what verification vendors, threat intelligence providers, and content screening tools actually do

Experience onboarding vendors and standing up new vendor relationships from scratch, not just managing existing ones

Strong cross-functional collaboration skills, particularly with legal, procurement, finance, and engineering teams

Comfort with ambiguity and fast-moving environments , you've built or significantly improved vendor management processes, not just inherited them

Nice to have:

Experience in AI safety or AI-adjacent vendor ecosystems

Familiarity with procurement tools such as Ironclad or Zip

Annual compensation range for this role is $245,000-$285,000 USD

XML job scraping automation by YubHub

The vendors and partners you'll manage span verification, threat intelligence, process outsourcing, capability evaluation, civil society consultation, and research collaboration. You'll build repeatable processes where they're needed while staying nimble enough to handle novel partnership structures, like research collaborations, civil society consultations, and model red-teaming engagements that don't fit neatly into standard procurement workflows.

You'll work closely with legal, procurement, finance, and engineering teams, and you'll be the person who knows where every Safeguards contract stands, what we're spending, and where we should consider a change.

This is a role for someone who's comfortable operating across commercial, legal, and technical contexts in a fast-moving environment , someone who can negotiate contract terms, work with legal teams to redline contracts, set up model access for a research partner, and handle a vendor performance issue in one day.

*Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature.

Responsibilities:

• Vendor Selection & Onboarding: Understand the broad vendor landscape for Safeguards and drive vendor selection processes with expert input, factoring in tradeoffs between capability, price, and internal resources across categories including verification, threat intelligence, process outsourcing, and capability evaluation
• Conduct vendor due diligence and coordinate security and data governance reviews for vendors handling sensitive model access or content
• Forecast future partnership needs and proactively research vendors and partners that could meet emerging Safeguards requirements
• Contract & Budget Management: Manage contracts across the Safeguards vendor and partner portfolio, working with legal and procurement teams on contract redlining, negotiation, and execution
• Work with legal teams and potential research partners to develop novel agreements for research collaboration, civil society consultation, and model red-teaming
• Handle invoicing, payment, and renewal processes with partners
• Own Safeguards vendor budget tracking and planning in partnership with finance teams, maintaining a clear picture of current spend and forecasting future needs
• Ongoing Vendor & Partner Management: Manage vendor and researcher access to models and products during testing phases and trials
• Oversee and monitor vendor performance and usage, flagging issues and resolving concerns and disputes as they arise
• Report on vendor performance, spend, and contract status to Safeguards leadership

Requirements:

• 5+ years in vendor management, procurement, or contract operations, ideally in risk, fraud, compliance, or trust & safety contexts at a technology company
• Demonstrated experience reviewing and negotiating contracts, including comfort with redlining and working alongside legal counsel
• Track record managing vendor budgets, including forecasting, tracking spend, and making tradeoff recommendations
• Understanding of AI safety, account abuse, or platform integrity issues , you know what verification vendors, threat intelligence providers, and content screening tools actually do
• Experience onboarding vendors and standing up new vendor relationships from scratch, not just managing existing ones
• Strong cross-functional collaboration skills, particularly with legal, procurement, finance, and engineering teams
• Comfort with ambiguity and fast-moving environments , you've built or significantly improved vendor management processes, not just inherited them

Nice to have:

• Experience in AI safety or AI-adjacent vendor ecosystems
• Familiarity with procurement tools such as Ironclad or Zip

Logistics:

• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
• Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
• Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
• Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

XML job scraping automation by YubHub

At OpenAI, our Trust, Safety & Risk Operations teams safeguard our products, users, and the company from abuse, fraud, scams, regulatory non-compliance, and other emerging risks. We operate at the intersection of operations, compliance, user trust, and safety working closely with Legal, Policy, Engineering, Product, Go-To-Market, and external partners to ensure our platforms are safe, compliant, and trusted by a diverse, global user base.

The Global Safety Response Operations team provides 24/7 coverage for user safety, risk, and regulatory escalations across OpenAI’s products, handling the highest-priority cases that require human judgment and rapid response. The team operates as the core escalation and delivery arm of OpenAI’s safety operations, ensuring that our products remain safe and aligned with policy while enabling timely, empathetic, and consistent user support.

About the Role

The Global Safety Response Operations Lead is a hands-on team lead who both manages a regional Safety Response team and personally handles high-risk safety cases. This role combines frontline safety work with people leadership, operational ownership, and cross-functional coordination.

You will lead a team of Safety Response Analysts who handle OpenAI’s most sensitive and high-impact cases, while also personally contributing to casework for complex, high-risk, or high-visibility issues. You will own the execution of high severity escalations in your region and ensure proper execution and communication to cross functional stakeholders

You will be accountable for ensuring your region consistently meets utilization, quality, and SLA targets while serving as the operational interface with Product, Policy, Legal, Investigations, and regional stakeholders.

This is a 24/7 global operation that requires flexibility to support rotating shifts, including nights, weekends, and holidays, as part of a leadership on-call model.

In This Role, You Will:

• Lead and coach a regional team of Safety Response Analysts, ensuring high performance, engagement, and consistent decision quality.

• Own regional operational outcomes, including utilization, SLA adherence, backlog health, and quality benchmarks.

• Handle and oversee the most complex and high-risk cases, serving as the first line of escalation and incident lead for your region.

• Contribute directly to frontline work (20–30%), including investigations, enforcement decisions, and regulatory or legal escalations.

• Partner cross-functionally with Product, Policy, Legal, Investigations, and local market teams to execute safety outcomes and manage risk.

• Drive operational excellence and continuous improvement, improving workflows, tools, automation, and escalation paths.

• Identify emerging risks and trends, translating frontline insights into actionable recommendations for policy, product, or enforcement.

You Might Thrive in This Role If You:

• You have 5+ years in Trust & Safety, Risk Operations, Investigations, Fraud, Annotation, or platform integrity.

• You have 4+ years of people leadership or senior-level operational ownership.

• You are a strong decision-maker in ambiguous, high-risk environments, able to balance speed, accuracy, and defensibility when handling sensitive or high-impact cases.

• You communicate complex safety and risk decisions clearly and credibly, whether writing escalation narratives, briefing Legal or Policy, or aligning Product and leadership during incidents.

• You can translate between frontline operations and strategic stakeholders, turning messy real-world cases into structured insights and turning policy or product direction into clear, executable guidance for your team.

• You are skilled at influencing without authority, building trust with Product, Policy, Legal, Investigations, and regional partners to drive alignment and resolve ambiguity.

• You are deeply familiar with content moderation, user safety, fraud, or developer risk frameworks, including the legal, policy, and technical considerations that shape enforcement.

• You use data, tooling, and automation to improve quality, efficiency, and scale to not just measure performance, but to make better decisions.

• You are comfortable leading in a 24/7, high-pressure operational environment, providing calm, credible leadership during incidents, spikes, and regulatory or reputational events.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

XML job scraping automation by YubHub

Data Scientist, Preparedness

Location

San Francisco

Employment Type

Full time

Department

Data Science

Compensation

• $347K – $400K • Offers Equity

The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.

• Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts

• Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)

• 401(k) retirement plan with employer match

• Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)

• Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees

• 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)

• Mental health and wellness support

• Employer-paid basic life and disability coverage

• Annual learning and development stipend to fuel your professional growth

• Daily meals in our offices, and meal delivery credits as eligible

• Relocation support for eligible employees

• Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.

More details about our benefits are available to candidates during the hiring process.

This role is at-will and OpenAI reserves the right to modify base pay and other compensation components at any time based on individual performance, team or company results, or market conditions.

About the Team

The Preparedness team is an important part of the Safety Systems org at OpenAI, and is guided by OpenAI’s Preparedness Framework.

Frontier AI models have the potential to benefit all of humanity, but also pose increasingly severe risks. To ensure that AI promotes positive change, the Preparedness team helps us prepare for the development of increasingly capable frontier AI models. This team is tasked with identifying, tracking, and preparing for catastrophic risks related to frontier AI models.

The mission of the Preparedness team is to:

1. Closely monitor and predict the evolving capabilities of frontier AI systems, with an eye towards misuse risks whose impact could be catastrophic to our society

1. Ensure we have concrete procedures, infrastructure and partnerships to mitigate these risks and to safely handle the development of powerful AI systems

Preparedness tightly connects capability assessment, evaluations, and internal red teaming, and mitigations for frontier models, as well as overall coordination on AGI preparedness. This is fast paced, exciting work that has far reaching importance for the company and for society.

About the Role

We’re hiring a Data Scientist to help build, evaluate, and continuously improve mitigations that prevent extreme harms from AI systems. This role is for an experienced, highly autonomous individual contributor who can take ambiguous problem statements, structure rigorous analyses, and translate findings into actionable product and policy changes.

This position goes beyond “running evals.” You’ll help create mitigation intelligence and monitoring systems that enable OpenAI to detect issues early, measure effectiveness over time, and reduce both over-blocking (unnecessary friction) and under-blocking (missed harm).

What You’ll Do

• Evaluate and improve mitigation systems, including classifiers and detection pipelines across domains (e.g., biosecurity, cybersecurity, and emerging risk areas).

• Diagnose false positives and false negatives with deep error analysis, root cause investigation, and clear recommendations for mitigation adjustments.

• Build monitoring and measurement frameworks to track mitigation effectiveness over time and across user segments and use cases.

• Identify trends in over-blocking vs. under-blocking, quantify customer impact, and propose prioritized interventions.

• Develop insights from customer feedback, complaints, and usage patterns to detect shifts in adversarial behavior and system failure modes.

• Expand risk monitoring into new areas, including cybersecurity threats and model loss-of-control or sabotage scenarios, in partnership with domain experts.

• Communicate results to technical and executive stakeholders with crisp narratives, decision-ready metrics, and clear tradeoffs.

You might thrive in this role if you are:

• An autonomous operator: you can take a problem statement and independently structure the analysis end-to-end.

• Strong at executive-ready communication: concise, clear, and outcome-oriented.

• Skilled in turning analysis into productable changes: you’re comfortable influencing across functions to drive mitigation improvements.

Qualifications

• Significant experience in data science or applied analytics in high-stakes domains (e.g., security, trust & safety, abuse prevention, fraud, platform integrity, or reliability).

• Strong foundations in experimentation, causal thinking, and/or observational inference; ability to design robust measurement under imperfect data.

• Fluency in SQL and Python (or equivalent) for analysis, modeling, and building monitoring workflows.

• Experience building metrics, dashboards, and operational monitoring that meaningfully changes outcomes (not just reporting).

• Track record of driving cross-functional impact with engineering, product, and research partners

XML job scraping automation by YubHub