In this position, you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.

Responsibilities:

Own the end-to-end enforcement strategy against unauthorized frontier model abuse , from detection signal development through enforcement action and post-enforcement measurement

Operationalize detection and review pipelines , translating leads from case investigations and detection outputs into structured review workflows that scale across surfaces

Drive enforcement actions for high-priority actors , synthesizing signals from across intelligence, detection, and review into enforcement packages suitable for formal escalation

Partner with Legal and Policy to assess case strength, characterize ToS and IP violations, and support enforcement escalations through formal channels

Close the loop between enforcement outcomes and upstream improvements , channeling review results and enforcement findings back to policy updates and detection refinements

Develop and maintain a dynamic enforcement framework that accounts for the complexity of cross-surface enforcement , including varied escalation paths, partner coordination, and enforcement consistency across surfaces

Collaborate with Threat Intelligence, Research, Engineering, and Policy partners to ensure detection coverage keeps pace with evolving frontier abuse tactics

Maintain rigorous documentation of enforcement decisions, pipeline logic, and precedents to build institutional knowledge

Qualifications:

Required

5+ years of experience in trust & safety, abuse enforcement, fraud investigation, policy, or a related field , with demonstrated ownership of complex, high-stakes enforcement programs

Track record of building detection and enforcement approaches for novel or emerging abuse vectors where established playbooks don't exist

Experience supporting or directly contributing to formal enforcement actions , including case documentation, evidence packaging, and escalation coordination

Strong data analysis skills , comfortable navigating complex, multi-table datasets to surface behavioral patterns and support investigations

Experience conducting structured investigations, including open-source intelligence techniques and cross-referencing external data sources to attribute activity

Demonstrated ability to translate ambiguous policy questions into defensible enforcement decisions and clear written findings

Strong written and verbal communication skills , able to present complex enforcement cases clearly to stakeholders across Legal, Policy, and Engineering

Preferred

Familiarity with the AI/ML ecosystem , including how model distillation, fine-tuning, and synthetic data generation work in practice, and how actors attempt to obscure this activity

Experience conducting threat actor profiling or open-source investigations in a trust & safety, intelligence, or legal context

Experience working with generative AI products, including using AI tools to accelerate investigative and analytical workflows

Background or interest in AI policy, IP enforcement, competitive intelligence, or AI governance

Experience coordinating with external enforcement partners or platform partners on escalated enforcement actions

Education: At least a Bachelor's degree in a relevant field, or equivalent experience.

The annual compensation range for this role is listed below.

For sales roles, the range provided is the role’s On Target Earnings (“OTE”) range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary: $230,000-$270,000 USD

XML job scraping automation by YubHub

You will work at the intersection of AI safety and CBRN security, conducting thorough investigations into potential misuse cases, developing novel detection techniques, and building robust defenses against threat actors who may attempt to leverage our AI technology for developing weapons, synthesizing dangerous compounds, or creating biological harm.

Important context: In this position you may be exposed to explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays.

Responsibilities:

• Detect and investigate attempts to misuse Anthropic's AI systems for developing, enhancing, or disseminating CBRN-E weapons, pathogens, toxins, or other threats to harm people, critical infrastructure, or the environment

• Conduct technical investigations using SQL, Python, and other tools to analyze large datasets, trace user behavior patterns, and uncover sophisticated CBRN-E threat actors

• Develop CBRN-E-specific detection capabilities, including abuse signals, tracking strategies, and detection methodologies tailored to dual-use research concerns

• Create actionable intelligence reports on CBRN-E attack vectors, vulnerabilities, and threat actor TTPs leveraging AI systems

• Conduct cross-platform threat analysis grounded in real threat actor behavior, open-source research, and publicly reported programs

• Collaborate with policy and enforcement teams to make informed decisions about user violations and ensure appropriate mitigation actions

• Engage with external stakeholders including government agencies, regulatory bodies, scientific organizations, and biosecurity/chemical security research communities

• Inform safety-by-design strategies by forecasting how threat actors may leverage advances in AI technology for CBRN-E purposes

You may be a good fit if you

• Have deep domain expertise in biosecurity, chemical defense, biological weapons non-proliferation, dual-use research of concern (DURC), synthetic biology, or related CBRN-E threat domains

• Have demonstrated proficiency in SQL and Python for data analysis and threat detection

• Have experience with threat actor profiling and utilizing threat intelligence frameworks

• Have hands-on experience with large language models and understanding of how AI technology could be misused for CBRN-E threats

• Have excellent stakeholder management skills and ability to work with diverse teams including researchers, policy experts, legal teams, and external partners

• Can present analytical work to both technical and non-technical audiences, including government stakeholders and senior leadership

Strong candidates may also have

• Advanced degree (MS or PhD) in biological sciences, chemistry, biodefense, biosecurity, or related field

• Real-world experience countering weapons of mass destruction or other high-risk asymmetric threats

• Experience working with government agencies or in regulated environments dealing with sensitive CBRN-E information

• Background in AI safety, machine learning security, or technology abuse investigation

• Familiarity with synthetic biology, biotechnology, or dual-use research

• Experience building and scaling threat detection systems or abuse monitoring programs

• Active Top Secret security clearance

The annual compensation range for this role is $230,000-$290,000 USD.

XML job scraping automation by YubHub

You will be a member of the user well-being team, with an initial focus on standing up detection, review, and escalation workflows for this domain , from tuning classifiers and curating evaluation datasets through to managing external partnerships and real-world harm escalation pathways.

This position may later expand to include broader areas of user well-being enforcement. Safety is core to our mission, and you'll help shape policy enforcement so that our users can interact with and build on top of our products across all surfaces in a harmless, helpful, and honest way.

In this position, you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.

Responsibilities:

• Design and architect automated enforcement systems and review workflows for human exploitation and abuse, ensuring they scale effectively while maintaining high accuracy

• Partner with Product, Engineering, and Data Science teams to build and tune detection signals for human trafficking, sextortion, and image-based sexual abuse, and to develop custom mitigations for these sensitive policy areas

• Curate policy violation examples, maintain golden evaluation datasets, and track enforcement actions across both consumer and API surfaces

• Conduct deep-dive investigations into suspected exploitation activity , using SQL and other data analysis tools to surface threat patterns and bad-actor behavior in large datasets , then produce clear, well-sourced intelligence reports that inform detection strategy and surface policy gaps to the Safeguards policy design team

• Study trends internally and in the broader ecosystem , including evolving trafficking and sextortion tactics , to anticipate how AI systems could be misused for exploitation as capabilities advance

• Review and investigate flagged content to drive enforcement decisions and policy improvements, exercising careful judgment on the line between permitted adult content and exploitative material

• Build and maintain relationships with external intelligence partners , including hotlines, NGOs, and industry hash-sharing consortia , to inform our approach and enable appropriate real-world escalation

You may be a good fit if you have:

• 3+ years of experience in trust and safety, content moderation, counter-exploitation work, or a related field

• Subject matter expertise in one or more of: human trafficking, human exploitation and abuse, sextortion, image-based sexual abuse / non-consensual intimate imagery, or commercial sexual exploitation

• Experience building or operating detection and review workflows for sensitive content, at a platform, NGO, hotline, or similar organization

• Ability to use SQL, Python, and/or other data analysis tools to interact with large datasets and derive insights that support key decisions and recommendations

• Demonstrated ability to analyze complex situations and make well-reasoned decisions under pressure

• Sound judgment in distinguishing permitted content from exploitative content, and comfort working in areas where these lines require careful reasoning

• Strong attention to detail and ability to maintain accurate documentation

• Ability to collaborate with team members while navigating rapidly evolving priorities and workstreams

Preferred:

• Familiarity with the NGO and industry ecosystem working on these harms (for example, Polaris Project, Thorn, NCMEC, IWF, StopNCII, or industry hash-sharing initiatives)

• Experience conducting open-source investigations or threat actor profiling in a trust & safety, intelligence, or law enforcement context

• Experience working with generative AI products, including writing effective prompts for content review and enforcement

• A deep interest in AI safety and responsible technology development

• Experience standing up real-world harm escalation pathways or working with law enforcement referral processes

The annual compensation range for this role is listed below.

For sales roles, the range provided is the role’s On Target Earnings (“OTE”) range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary: $245,000-$285,000 USD

XML job scraping automation by YubHub

In this position, you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.

Responsibilities:

• Own the end-to-end enforcement strategy against unauthorized frontier model abuse , from detection signal development through enforcement action and post-enforcement measurement
• Operationalize detection and review pipelines , translating leads from case investigations and detection outputs into structured review workflows that scale across surfaces
• Drive enforcement actions for high-priority actors , synthesizing signals from across intelligence, detection, and review into enforcement packages suitable for formal escalation
• Partner with Legal and Policy to assess case strength, characterize ToS and IP violations, and support enforcement escalations through formal channels
• Close the loop between enforcement outcomes and upstream improvements , channeling review results and enforcement findings back to policy updates and detection refinements
• Develop and maintain a dynamic enforcement framework that accounts for the complexity of cross-surface enforcement , including varied escalation paths, partner coordination, and enforcement consistency across surfaces
• Collaborate with Threat Intelligence, Research, Engineering, and Policy partners to ensure detection coverage keeps pace with evolving frontier abuse tactics
• Maintain rigorous documentation of enforcement decisions, pipeline logic, and precedents to build institutional knowledge

Qualifications:

• 5+ years of experience in trust & safety, abuse enforcement, fraud investigation, policy, or a related field , with demonstrated ownership of complex, high-stakes enforcement programs
• Track record of building detection and enforcement approaches for novel or emerging abuse vectors where established playbooks don't exist
• Experience supporting or directly contributing to formal enforcement actions , including case documentation, evidence packaging, and escalation coordination
• Strong data analysis skills , comfortable navigating complex, multi-table datasets to surface behavioral patterns and support investigations
• Experience conducting structured investigations, including open-source intelligence techniques and cross-referencing external data sources to attribute activity
• Demonstrated ability to translate ambiguous policy questions into defensible enforcement decisions and clear written findings
• Strong written and verbal communication skills , able to present complex enforcement cases clearly to stakeholders across Legal, Policy, and Engineering

Preferred qualifications include familiarity with the AI/ML ecosystem, experience conducting threat actor profiling or open-source investigations, and experience working with generative AI products.

XML job scraping automation by YubHub

You will be a member of the user well-being team, and your initial focus will be on standing up detection, review, and escalation workflows for this domain , from tuning classifiers and curating evaluation datasets through to managing external partnerships and real-world harm escalation pathways.

This position may later expand to include broader areas of user well-being enforcement. Safety is core to our mission, and you'll help shape policy enforcement so that our users can interact with and build on top of our products across all surfaces in a harmless, helpful, and honest way.

In this position, you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.

Responsibilities:

• Design and architect automated enforcement systems and review workflows for human exploitation and abuse, ensuring they scale effectively while maintaining high accuracy

• Partner with Product, Engineering, and Data Science teams to build and tune detection signals for human trafficking, sextortion, and image-based sexual abuse, and to develop custom mitigations for these sensitive policy areas

• Curate policy violation examples, maintain golden evaluation datasets, and track enforcement actions across both consumer and API surfaces

• Conduct deep-dive investigations into suspected exploitation activity , using SQL and other data analysis tools to surface threat patterns and bad-actor behavior in large datasets , then produce clear, well-sourced intelligence reports that inform detection strategy and surface policy gaps to the Safeguards policy design team

• Study trends internally and in the broader ecosystem , including evolving trafficking and sextortion tactics , to anticipate how AI systems could be misused for exploitation as capabilities advance

• Review and investigate flagged content to drive enforcement decisions and policy improvements, exercising careful judgment on the line between permitted adult content and exploitative material

• Build and maintain relationships with external intelligence partners , including hotlines, NGOs, and industry hash-sharing consortia , to inform our approach and enable appropriate real-world escalation

Requirements:

• 3+ years of experience in trust and safety, content moderation, counter-exploitation work, or a related field

• Subject matter expertise in one or more of: human trafficking, human exploitation and abuse, sextortion, image-based sexual abuse / non-consensual intimate imagery, or commercial sexual exploitation

• Experience building or operating detection and review workflows for sensitive content, at a platform, NGO, hotline, or similar organization

• Ability to use SQL, Python, and/or other data analysis tools to interact with large datasets and derive insights that support key decisions and recommendations

• Demonstrated ability to analyze complex situations and make well-reasoned decisions under pressure

• Sound judgment in distinguishing permitted content from exploitative content, and comfort working in areas where these lines require careful reasoning

• Strong attention to detail and ability to maintain accurate documentation

• Ability to collaborate with team members while navigating rapidly evolving priorities and workstreams

Preferred Qualifications:

• Familiarity with the NGO and industry ecosystem working on these harms (for example, Polaris Project, Thorn, NCMEC, IWF, StopNCII, or industry hash-sharing initiatives)

• Experience conducting open-source investigations or threat actor profiling in a trust & safety, intelligence, or law enforcement context

• Experience working with generative AI products, including writing effective prompts for content review and enforcement

• A deep interest in AI safety and responsible technology development

• Experience standing up real-world harm escalation pathways or working with law enforcement referral processes

Compensation:

The annual compensation range for this role is $245,000-$285,000 USD.

XML job scraping automation by YubHub

We are looking for a Technical Cyber Threat Investigator to join our Threat Intelligence team. In this role, you will be responsible for detecting, investigating, and disrupting the misuse of Anthropic's AI systems for malicious cyber operations.

You will work at the intersection of AI safety and cybersecurity, conducting thorough investigations into potential misuse cases, developing novel detection techniques, and building robust defenses against emerging cyber threats in the rapidly evolving landscape of AI-enabled risks. Your work will directly protect the broader ecosystem from sophisticated threat actors who seek to leverage AI technology for harm.

Responsibilities

• Detect and investigate attempts to misuse Anthropic's AI systems for cyber operations, including influence operations, malware development, social engineering, and other adversarial activities

• Develop abuse signals and tracking strategies to proactively detect sophisticated threat actors across our platform

• Create actionable intelligence reports on new attack vectors, vulnerabilities, and threat actor TTPs targeting LLM systems

• Conduct cross-platform threat analysis grounded in real threat actor behavior, using open-source research, dark web monitoring, and internal data

• Utilize investigation findings to implement systematic improvements to our safety approach and mitigate harm at scale

• Study trends internally and in the broader ecosystem to anticipate how AI systems could be misused, generating and publishing reports

• Build and maintain relationships with external threat intelligence partners, information sharing communities, and government stakeholders

• Work cross-functionally to build out our threat intelligence program, establishing processes, tools, and best practices

You may be a good fit if you

• Have demonstrated proficiency in SQL and Python for data analysis and threat detection

• Have experience with large language models and understanding of how AI technology could be misused for cyber threats

• Have subject matter expertise in abusive user behaviour detection, such as influence operations, coordinated inauthentic behaviour, or cyber threat intelligence

• Have experience tracking threat actors across surface, deep, and dark web environments

• Can derive insights from large datasets to make key decisions and recommendations

• Have experience with threat actor profiling and utilising threat intelligence frameworks (MITRE ATT&CK, etc.)

• Have strong project management skills and ability to build processes from the ground up

• Possess excellent communication skills to collaborate with cross-functional teams and present to leadership

Strong candidates may also have

• Experience working with government agencies or in regulated environments

• Background in AI safety, machine learning security, or technology abuse investigation

• Experience building and scaling threat detection systems or abuse monitoring programs

• Active Top Secret security clearance

Deadline to apply

None. Applications will be reviewed on a rolling basis.

Logistics

• Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience.

• Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

• Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification.

Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work.

Your safety matters to us.

To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/career

XML job scraping automation by YubHub

We are looking for a Technical CBRN-E Threat Investigator to join our Threat Intelligence team. In this role, you will be responsible for detecting, investigating, and disrupting the misuse of Anthropic's AI systems for Chemical, Biological, Radiological, Nuclear, and Explosives (CBRN-E) threats.

Responsibilities

• Detect and investigate attempts to misuse Anthropic's AI systems for developing, enhancing, or disseminating CBRN-E weapons, pathogens, toxins, or other threats to harm people, critical infrastructure, or the environment

• Conduct technical investigations using SQL, Python, and other tools to analyze large datasets, trace user behavior patterns, and uncover sophisticated CBRN-E threat actors

• Develop CBRN-E-specific detection capabilities, including abuse signals, tracking strategies, and detection methodologies tailored to dual-use research concerns

• Create actionable intelligence reports on CBRN-E attack vectors, vulnerabilities, and threat actor TTPs leveraging AI systems

• Conduct cross-platform threat analysis grounded in real threat actor behavior, open-source research, and publicly reported programs

• Collaborate with policy and enforcement teams to make informed decisions about user violations and ensure appropriate mitigation actions

• Engage with external stakeholders including government agencies, regulatory bodies, scientific organizations, and biosecurity/chemical security research communities

• Inform safety-by-design strategies by forecasting how threat actors may leverage advances in AI technology for CBRN-E purposes

You may be a good fit if you

• Have deep domain expertise in biosecurity, chemical defense, biological weapons non-proliferation, dual-use research of concern (DURC), synthetic biology, or related CBRN-E threat domains

• Have demonstrated proficiency in SQL and Python for data analysis and threat detection

• Have experience with threat actor profiling and utilizing threat intelligence frameworks

• Have hands-on experience with large language models and understanding of how AI technology could be misused for CBRN-E threats

• Have excellent stakeholder management skills and ability to work with diverse teams including researchers, policy experts, legal teams, and external partners

Strong candidates may also have

• Advanced degree (MS or PhD) in biological sciences, chemistry, biodefense, biosecurity, or related field

• Real-world experience countering weapons of mass destruction or other high-risk asymmetric threats

• Experience working with government agencies or in regulated environments dealing with sensitive CBRN-E information

• Background in AI safety, machine learning security, or technology abuse investigation

• Familiarity with synthetic biology, biotechnology, or dual-use research

• Experience building and scaling threat detection systems or abuse monitoring programs

• Active Top Secret security clearance

Logistics

• Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience.

• Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

• Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work.

XML job scraping automation by YubHub