Typical problems you will deal with include designing efficient and robust environments for AI agents, improving evaluations and observability, onboarding new evaluation datasets, standardizing preprocessing pipelines, and creating data augmentation pipelines.

Responsibilities include creating and maintaining frameworks for agent, data, and model evaluation tasks, building environments for AI agents, tools for automating common workflows, improving alerts, metrics, and error handling on large-scale RL jobs, refactoring existing frameworks for better modularity, and designing operation procedures and coding standards.

Basic qualifications include experience building and maintaining frameworks, building high-performance sandboxes, virtual machines, and simulations, building full-stack apps for automating workflows and data visualization, rapid iteration of research to production cycles, and test automation, CI/CD.

Base salary is $180,000 - $440,000 USD, and our total rewards package includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

XML job scraping automation by YubHub

Responsibilities: Review and score AI model responses based on criteria such as humor effectiveness, timing, engagement, and conversational naturalness (using provided rubrics). Write or revise sample responses to maximize user engagement and entertainment, while ensuring factual accuracy. Maintain consistency in Grok's personality traits across varied topics (e.g., casual chat, technical explanations, philosophical discussions, humor). Create and label training datasets focused on elements like humor, irony, banter, and cultural references. Work with engineering teams to develop evaluation tasks that test and strengthen Grok's defined personality traits.

Basic Qualifications: Advanced proficiency in English, including idioms, rhythm, tone, and nuance (native or equivalent level). Public portfolio with examples of humorous, engaging, or charismatic writing (e.g., published articles, social media threads, scripts, or viral content; provide links). Strong ability to identify tonal inconsistencies, poor pacing, or ineffective phrasing in text. Proven track record of creating writing that is consistently humorous, clever, or engaging, with evidence of broad appeal (e.g., metrics like views, shares, likes, or publications). Extensive knowledge of current internet culture (memes, trends, platforms) and historical/cultural references.

Preferred Skills and Experience: Professional experience in comedy writing, screenwriting, viral content, improvisation, or performance.

XML job scraping automation by YubHub