You will drive system-level design decisions that enable Alluxio to scale to thousands of nodes and exabytes of data, while maintaining performance, reliability, and simplicity for users.

In this role, you will operate as a technical architect and hands-on engineering leader, partnering closely with engineering teams and product management to translate complex requirements into scalable distributed system designs.

Responsibilities

• Lead the end-to-end architecture and design of large-scale distributed systems powering the Alluxio platform.
• Drive technical strategy and architectural direction across multiple teams and components.
• Design systems that support high scalability, fault tolerance, performance optimization, and data durability.
• Provide hands-on development and deep technical guidance in critical areas of the system.
• Lead complex system design reviews and mentor senior engineers on distributed systems design.
• Identify and resolve system-level performance bottlenecks and reliability challenges.
• Collaborate with product management and engineering leadership to translate product goals into technical solutions.
• Influence the broader technical ecosystem through open-source contributions and architectural thought leadership.

Requirements

• Master or BS degree in Computer Science or related technical field, or equivalent practical experience.
• Proven experience of 2+ years in a technical leadership or architect role, driving system-level design and guiding engineering teams.
• Strong hands-on software development experience in one or more general-purpose programming languages, including but not limited to Java, C/C++, or Go.
• Deep architecting expertise in at least two of the following areas:
• Distributed and parallel systems
• Distributed storage systems
• Architecting large-scale software systems
• Demonstrated ability to design and implement high-quality, stable, and scalable end-to-end system architectures in production environments.
• Strong analytical thinking and complex problem-solving skills.
• Excellent communication skills and ability to influence technical direction across teams.

Nice to Have

• PhD in Computer Science, Distributed Systems, or related fields.
• Deep understanding of consensus algorithms, storage engines, or large-scale data systems.
• Experience building or operating cloud-native infrastructure platforms.
• Experience contributing to or maintaining open-source distributed systems projects.
• Track record of designing systems that operate at massive scale (thousands of nodes or higher).
• Passion for building high-performance infrastructure software.
• Contributions to Alluxio open-source community.

XML job scraping automation by YubHub

As a distributed systems engineer at Alluxio, you will be responsible for evolving the state-of-the-art Alluxio project. The work would involve solving challenging problems in the area of Distributed Data Services, Memory and data structure efficiency, Thread concurrency and locking optimizations, process coordination and caching policies and implementation.

The role would include developing innovative solutions for scaling systems to thousands of nodes and providing Data Durability and High Availability.

You will be part of a team that includes leaders, innovators, explorers, and risk-takers with extensive industry experience from top tech companies including Google, Palantir and VMWare and alumni from top computer science programs including CMU, Stanford and UC Berkeley.

We are looking for someone with a BS degree in Computer Science, similar technical field of study or equivalent practical experience. You should have software development experience in one or more general purpose programming languages including but not limited to: Java, C/C++, or Go.

Experience working with two or more from the following is a must: distributed and parallel systems, distributed storage systems, architecting large scale software systems, and/or security software development.

Excellent analytical and problem solving skills are required. Working proficiency and communication skills in verbal and written English are also necessary.

Preferred qualifications include a Master’s, PhD degree, further education or equivalent practical experience in engineering, computer science or other technical related field. Experience designing, developing, and deploying Kubernetes applications is also desirable.

If you are interested in contributing to an open source project and want to work in a fast-paced, collaborative and iterative programming environment, please apply.

XML job scraping automation by YubHub

Location

San Francisco

Employment Type

Full time

Department

Scaling

Compensation

• $295K – $555K • Offers Equity

The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.

• Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts

• Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)

• 401(k) retirement plan with employer match

• Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)

• Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees

• 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)

• Mental health and wellness support

• Employer-paid basic life and disability coverage

• Annual learning and development stipend to fuel your professional growth

• Daily meals in our offices, and meal delivery credits as eligible

• Relocation support for eligible employees

• Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.

More details about our benefits are available to candidates during the hiring process.

This role is at-will and OpenAI reserves the right to modify base pay and other compensation components at any time based on individual performance, team or company results, or market conditions.

About the Team

OpenAI’s Inference team powers the deployment of our most advanced models - including our GPT models, 4o Image Generation, and Whisper - across a variety of platforms. Our work ensures these models are available, performant, and scalable in production, and we partner closely with Research to bring the next generation of models into the world. We're a small, fast-moving team of engineers focused on delivering a world-class developer experience while pushing the boundaries of what AI can do.

We’re expanding into multimodal inference, building the infrastructure needed to serve models that handle image, audio, and other non-text modalities. These workloads are inherently more heterogeneous and experimental, involving diverse model sizes and interactions, more complex input/output formats, and tighter coordination with product and research.

About the Role

We’re looking for a software engineer to help us serve OpenAI’s multimodal models at scale. You’ll be part of a small team responsible for building reliable, high-performance infrastructure for serving real-time audio, image, and other MM workloads in production.

This work is inherently cross-functional: you’ll collaborate directly with researchers training these models and with product teams defining new modalities of interaction. You'll build and optimize the systems that let users generate speech, understand images, and interact with models in ways far beyond text.

In this role, you will:

• Design and implement inference infrastructure for large-scale multimodal models.

• Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs.

• Enable experimental research workflows to transition into reliable production services.

• Collaborate closely with researchers, infra teams, and product engineers to deploy state-of-the-art capabilities.

• Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction layers.

You might thrive in this role if you:

• Have experience building and scaling inference systems for LLMs or multimodal models.

• Have worked with GPU-based ML workloads and understand the performance dynamics of large models, especially with complex data like images or audio.

• Enjoy experimental, fast-evolving work and collaborating closely with research.

• Are comfortable dealing with systems that span networking, distributed compute, and high-throughput data handling.

• Have familiarity with inference tooling like vLLM, TensorRT-LLM, or custom model parallel systems.

• Own problems end-to-end and are excited to operate in ambiguous, fast-moving spaces.

Nice to Have:

• Experience working with image generation or audio synthesis models in production.

• Exposure to distributed ML training or system-efficient model design.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

XML job scraping automation by YubHub