You will help define best practices for developers building on claude for deployment to users across different developmental stages, design age-assurance policies that protect minors from inappropriate content and interactions, and establish clear boundaries for adult content and experiences. In addition, you will advise teams on opportunities for age-appropriate helpfulness, including advising cross-functional teams on beneficial use cases for younger users where appropriate.

Safety is core to our mission and you’ll help shape policy creation and development so that our users can safely interact with and build on top of our products in a harmless, helpful and honest way.

Responsibilities:

• Serve as an internal subject matter expert, leveraging deep expertise in child safety, adult content, youth development, and age-appropriate design to:

• Draft new policies that help govern the responsible use of our models for emerging capabilities and use cases

• Design evaluation frameworks for testing model performance in areas of expertise

• Conduct regular reviews and testing of existing policies to identify and address gaps and ambiguities

• Review flagged content to drive enforcement and policy improvements

• Update our usage policies based on feedback collected from external experts, our enforcement team, and edge cases that you will review

• Work with safeguards product teams to identify and mitigate concerns, and collaborate on designing appropriate interventions for users across different age groups

• Advise on age assurance approaches and content classification frameworks in partnership with Enforcement, Product, Engineering, and Legal teams

• Educate and align internal stakeholders around our policies and our approach to safety in your focus area(s)

• Keep up to date with new and existing AI policy norms, regulatory requirements (e.g., age-appropriate design codes), and industry standards, and use these to inform our decision-making on policy areas

Requirements:

• As a researcher, subject matter expert, or trust & safety professional working in one or more of the following focus areas: child safety, youth online safety, age assurance, developmental science, content classification and rating systems, or adult content policy.

• Drafting or updating product and / or user policies, with the ability to effectively bridge technical and policy discussions

• Designing or implementing age-appropriate experiences, age assurance mechanisms, or content classification / labeling systems

• Working with generative AI products, including writing effective prompts for policy evaluations and classifier development

• Aligning product policy decisions between diverse sets of stakeholders, such as Product, Engineering, Public Policy, and Legal teams

• Understanding the challenges that exist in developing and implementing product policies at scale, including in the content moderation space

• Thinking creatively about the risks and benefits of new technologies, and leveraging data and research to inform policy recommendations

• Navigating and prioritizing work efforts amidst ambiguity

Salary:

$245,000-$285,000 USD

XML job scraping automation by YubHub

You will help define best practices for developers building on claude for deployment to users across different developmental stages, design age-assurance policies that protect minors from inappropriate content and interactions, and establish clear boundaries for adult content and experiences. In addition, you will advise teams on opportunities for age-appropriate helpfulness, including advising cross-functional teams on beneficial use cases for younger users where appropriate.

Safety is core to our mission and you’ll help shape policy creation and development so that our users can safely interact with and build on top of our products in a harmless, helpful and honest way.

You may be a good fit if you have experience:

As a researcher, subject matter expert, or trust & safety professional working in one or more of the following focus areas: child safety, youth online safety, age assurance, developmental science, content classification and rating systems, or adult content policy.

Drafting or updating product and / or user policies, with the ability to effectively bridge technical and policy discussions.

Designing or implementing age-appropriate experiences, age assurance mechanisms, or content classification / labeling systems.

Working with generative AI products, including writing effective prompts for policy evaluations and classifier development.

Aligning product policy decisions between diverse sets of stakeholders, such as Product, Engineering, Public Policy, and Legal teams.

Understanding the challenges that exist in developing and implementing product policies at scale, including in the content moderation space.

Thinking creatively about the risks and benefits of new technologies, and leveraging data and research to inform policy recommendations.

Navigating and prioritizing work efforts amidst ambiguity.

The annual compensation range for this role is $245,000-$285,000 USD.

XML job scraping automation by YubHub

xAI is seeking a Senior Analyst - Safety Operations (CSE) to join our team. As a Senior Analyst, you will play a critical role in ensuring the safety and integrity of our AI systems.

Responsibilities

• Process appeals, audit automations, and properly label use cases in the system.
• Provide labels, annotations, and inputs on projects involving safety protocols, risk scenarios, and policy compliance.
• Support the delivery of high-quality curated data that reinforces xAI's rules and ethical alignment.
• Collaborate with team members to provide feedback on tasks that improve AI's defenses to detect illegal and unethical behavior, as well as align Grok with our rules enforcement.

Basic Qualifications

• Expertise in improving Large Language Models (LLMs), specifically related to CSE, to maximize efficiencies in enforcement and support and ability to propose solutions to increase security and safety of our platform.
• Proven expertise in identifying, mitigating, and preventing Child Sexual Abuse Material (CSAM) and Child Sexual Exploitation (CSE), including grooming behaviors and risks in AI-generated content, with strong knowledge of relevant legal obligations (such as NCMEC reporting) and industry standards for protecting minors.
• Proven experience in online safety and reducing harm to protect our users and preserve Free Speech in the global public square.
• Ability to interpret and apply xAI safety policies effectively.
• Proficiency in analyzing complex scenarios, with strong skills in ethical reasoning and risk assessment.
• Strong ability to utilize resources, guidelines, and frameworks for accurate safety-focused actions and escalations.
• Strong communication, interpersonal, analytical, and ethical decision-making skills.
• Commitment to continuous improvement of processes to prioritize safety and risk mitigation.
• Expertise in data analysis to identify emerging abuse vectors, uncover opportunities for operational efficiencies, and design automations that strengthen enforcement effectiveness and platform safety.

Preferred Skills and Experience

• Experience working in a Trust and Safety for a social media company, leveraging AI or other automation tools.
• Experience collaborating with child safety organizations (such as NCMEC) and utilizing specialized detection tools or developing classifiers for CSAM/CSE in social media or generative AI platforms.
• Expertise in red-teaming and adversarial testing of Large Language Models to proactively identify novel abuse vectors, jailbreaks, and safety failure modes, with a proven ability to translate findings into concrete improvements for enforcement systems and platform robustness.

This role may involve exposure to sensitive or graphic content, including vulgar language, violent threats, pornography, and other graphic images.

XML job scraping automation by YubHub