Research Engineer/Scientist - Generative UI, Consumer Products

Location

San Francisco

Employment Type

Full time

Location Type

Hybrid

Department

Consumer Products

Compensation

• $380K – $460K • Offers Equity

The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.

• Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts

• Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)

• 401(k) retirement plan with employer match

• Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)

• Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees

• 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)

• Mental health and wellness support

• Employer-paid basic life and disability coverage

• Annual learning and development stipend to fuel your professional growth

• Daily meals in our offices, and meal delivery credits as eligible

• Relocation support for eligible employees

• Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.

More details about our benefits are available to candidates during the hiring process.

This role is at-will and OpenAI reserves the right to modify base pay and other compensation components at any time based on individual performance, team or company results, or market conditions.

About the Team

The Future of Computing Research team is an Applied Research team focused on developing new methods and models to support our vision for the future of computing as we advance forward in our mission of building AGI that benefits all of humanity.

About the Role

As a Research Engineer/Scientist on the Consumer Products Research team, you will work together with _both_ the best ML researchers in the world and the greatest design talent of our generation to push the frontier of model capabilities.

This role is based in San Francisco, CA. We follow a hybrid model with 4 days a week in the office and offer relocation assistance to new employees.

In this role you will:

• Train and evaluate SoTA models along axis that are important to our vision for future devices.

• Run through the necessary walls to take nascent research capabilities and turn them into capabilities we can build on top of.

• Help define how software works for decades to come.

You might thrive in this role if you:

• Have 5+ years of relevant work experience.

• Have a research background in utilizing and training language models to generate UI, and developing recipes to evaluate the quality / applicability of UI generated.

• Love exposure to a bit of everything – we’re collaborators with a hugely diverse set of research.

• Do rigorous science (rather than vibes based). We need confidence in the experiments we run to move quickly.

• Have already spent time in the weeds teaching models to speak and perceive.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

XML job scraping automation by YubHub

San Francisco

Employment Type

Full time

Location Type

Hybrid

Department

Consumer Products

Compensation

• $380K – $445K • Offers Equity

The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.

• Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts

• Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)

• 401(k) retirement plan with employer match

• Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)

• Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees

• 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)

• Mental health and wellness support

• Employer-paid basic life and disability coverage

• Annual learning and development stipend to fuel your professional growth

• Daily meals in our offices, and meal delivery credits as eligible

• Relocation support for eligible employees

• Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.

More details about our benefits are available to candidates during the hiring process.

This role is at-will and OpenAI reserves the right to modify base pay and other compensation components at any time based on individual performance, team or company results, or market conditions.

About the Team

The Future of Computing Research team is an Applied Research team within the Consumer Products group focused on developing new methods and models to support our vision for the future of computing as we advance forward in our mission of building AGI that benefits all of humanity.

About the Role

As a Research Engineer/Scientist on the Future of Computing Research team, you will work together with _both_ the best ML researchers in the world and the greatest design talent of our generation to push the frontier of model capabilities.

This role is based in San Francisco, CA. We follow a hybrid model with 4 days a week in the office and offer relocation assistance to new employees.

In this role you will:

• Train and evaluate multimodal SoTA models along axis that are important to our vision for future devices.
• Develop novel architectures that improve model performance when scaling the models themselves is not an option.
• Run through the necessary walls to take nascent research capabilities and turn them into capabilities we can build on top of.

You might thrive in this role if you:

• Have a research background related to developing on-device transformer models.
• Love performance optimization and working with GPU kernel engineers (but you do not need CUDA experience yourself).
• Do rigorous science (rather than vibes based). We need confidence in the experiments we run to move quickly.
• Have already spent time in the weeds teaching models to speak and perceive.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

XML job scraping automation by YubHub

San Mateo, CA, United States

Early Career

ID: 5825

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device.

We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

WHY DATA SCIENCE & ANALYTICS?

The Data Science & Analytics organization's mission is to increase our speed, frequency, and acumen in making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum, including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling, and machine learning. Aligned and partnered with product verticals, we use this extensive tool belt to discover new opportunities and unmet use cases, influence and craft the product roadmap, and prioritize, build data products, and measure impact on our community of players and developers.

WHY GENERATIVE AI?

Our team’s mission is to enable Roblox Creators to bring GenAI capabilities to millions of users. We drive this innovation with a core commitment to safety, responsibility, and quality.

As a Data Scientist, you will play a critical role in evaluation and optimization for user-facing GenAI systems (such as text, image, video, 3D, 4D). You will define how we measure safety, responsibility, quality, and efficiency. You will combine annotation analysis, design of experiments, causal inference, model-based evaluation methods (such as LLM-as-a-judge), optimization algorithm, and AI models to drive product decisions and model improvements.

You Will:

• Develop Evaluation Frameworks: Design and operationalize rigorous evaluation systems for either GenAI features (text, image, video, 3D, 4D). This includes eval experiment design, dataset design, label reliability analysis, and implementing and finetuning LLM-as-judge methods.

• Run Rigorous Experiments: Conduct online experiments (A/B tests) and causal inference to quantify the impact of GenAI features. You will identify opportunities, measure lift, and ensure statistical rigor.

• Define Success Metrics: Partner with cross-functional teams to define leading/lagging indicators for GenAI feature user satisfaction, business success, and safety.

• Build Automated Systems: Research and apply state-of-the-art methodologies to build reproducible evaluation tooling that lift rigor and efficiency across the company.

• Conduct Applied Research at the Frontier: Maintain an active pulse on the intersection of Gen AI and Data Science. You will innovate on methodology and techniques to solve unique business challenges while contributing to the broader field in the technical community.

You Have:

• Possess or pursuing a PhD or equivalent in Statistics, Economics, Computer Science, Applied Math, Physics, Engineering, or a related quantitative field.

• Technical Proficiency: Strong proficiency in SQL (Hive/Spark) for manipulating large datasets and scripting languages (Python or R) for analysis and modeling.

• Experimentation and Causal Inference: A solid grounding in experimentation, causal inference, and statistical analysis, including test design and metric design for feature impact.

• Problem Solving: A demonstrated track record of framing ambiguous problems, designing analytical approaches, and solving open-ended data science problems that drive business impact.

• Learning Agility: Ability to effectively and responsibly use AI tools to enhance productivity and a passion for continuously improving methods in a fast-evolving field.

• GenAI Familiarity: Familiarity with GenAI models and safety/quality evaluation methods. Expertise in the model training lifecycle is a plus (e.g., fine-tuning, RLHF, or synthetic data generation).

• Applied Research Background: A track record of applied research or publications in relevant technical fields is highly valued.

You may redact age, date of birth, and dates of attendance/graduation from your resume if you prefer.

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.

Annual Salary Range

$185,860—$221,380 USD

Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).

XML job scraping automation by YubHub

Microsoft AI are looking for a talented Technical Program Manager to help bring their vision to life. This role sits at the heart of strategic decision-making, turning market data into actionable insights for a company that's revolutionising AI frontier models. You'll work directly with leadership to shape the company's direction in the AI and society markets.

About the Role

As a Technical Program Manager, you will establish and operationalize AI safety, governance, and responsibility practices across the model lifecycle. You will work directly with world-leading researchers to identify risks, set responsible AI standards, and ensure that appropriate mitigations are in place before their models are released. You will collaborate with fast-paced model development teams to identify risks, develop policies and evaluations, and ensure appropriate mitigations are in place prior to deployment.

Accountabilities

• Collaborate with fast-paced model development teams to identify risks, develop policies and evaluations, and ensure appropriate mitigations are in place prior to deployment.
• Establish, improve, and operationalize foundation model governance processes, ensuring Microsoft Superintelligence addresses key risks and develops models that benefit people and society.

The Candidate we're looking for

Experience:

• Related bachelor's degree AND experience in AI policy, AI governance, or a related field OR equivalent experience.

Technical skills:

• Demonstrated experience identifying and addressing risks related to frontier AI through both technical and non-technical measures.

Personal attributes:

• Proven ability to collaborate with highly technical stakeholders, identify novel risks from technical specifications, and guide mitigation efforts.

Benefits

• Microsoft's mission is to empower every person and every organization on the planet to achieve more.
• As employees, they come together with a growth mindset, innovate to empower others, and collaborate to realize their shared goals.
• Each day, they build on their values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

XML job scraping automation by YubHub

What you'll do

• Architect and maintain automated evaluation pipelines to assess answer quality across Perplexity's products, ensuring high standards for accuracy and helpfulness
• Design evaluation sets and methods specifically to measure the impact of tool calls (particularly web search retrieval) on the final answer's quality

What you need

• PhD or MS in a technical field or equivalent experience
• 4+ years of experience in data science or machine learning

XML job scraping automation by YubHub