Shape Testing Strategy for AI-Native Products

• Design and own end-to-end test strategies,automated and manual,for products that integrate LLMs, generative AI, and complex data pipelines.
• Develop novel evaluation frameworks for LLM output quality, prompt regression testing, and RAG retrieval accuracy.
• Select, implement, and continuously improve testing tools and frameworks in collaboration with engineering leadership and platform excellence teams.
• Drive a measurable shift from manual to automated testing, with clear metrics to track progress.

Own Quality and Release Readiness

• Be the single point of accountability for testing across all releases of your two products.
• Build and maintain automation frameworks and scripts that keep pace with rapid release cycles.
• Analyse test results, spot trends, and turn data into actionable improvements,not just reports.
• Prepare release-readiness documentation and quality artifacts that satisfy both internal stakeholders and GxP compliance requirements.

Lead, Coach, and Build Culture

• Partner with engineering managers, scrum masters, and delivery leads across squads and geographies to establish a shared quality vision.
• Lead external contract test engineering squads by influence,setting standards, mentoring team members, and modelling engineering excellence.
• Champion a quality-engineering mindset: everyone ships quality, not just the test team.
• Stay hands-on,write test cases, debug failures, and pair with engineers when the situation calls for it.

Essential Skills and Experience

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or a related field (or equivalent practical experience).
• 10+ years of hands-on software test engineering experience across the full stack (UI, API, data).
• Proven ability to lead test strategy and mentor other test engineers,whether through formal management or technical leadership.
• Strong automation skills with modern frameworks such as Playwright, Selenium, or Cypress, plus scripting fluency in Python or a comparable language.
• Solid experience with REST API testing, database validation (PostgreSQL, MongoDB, or similar), and CI/CD-integrated test pipelines.
• A data-driven approach to quality: you define metrics, instrument dashboards, and use evidence to drive decisions.

Highly Preferred

• Experience testing AI/ML-powered products,especially LLM evaluation, prompt testing, RAG validation, or output-quality benchmarking.
• Familiarity with GxP software validation, computerised system validation (CSV), or regulated-industry quality practices.
• Background in life sciences, health-tech, or clinical-trial technology.
• Experience working with geographically distributed teams and external vendor squads.

If you're looking for a role where deep test engineering craft meets the frontier of AI,and where your work genuinely improves patient outcomes,this is it.

XML job scraping automation by YubHub

The Test and Evaluation team at Anduril works across the entire spectrum of products and business lines, as well as all flight operations and test range management. Our team conducts full system level development testing, new production acceptance testing, sub-component qualification testing and much more. In short, if it involves test, we support it.

If you are interested in working in an extremely innovative and fast-paced environment, where your work directly makes an impact and difference in the products that are fielded, this is a fantastic opportunity.

Responsibilities

• Plan and execute system level T&E of hardware and software with emphasis placed on resource planning, conducting ground and flight test, initial issue investigation, and process improvement/development.

• Act as lead or supporting test engineer for missile or weapon systems to include development, certification and integration test of subsystems to the AUR configuration.

• Collect test data and perform initial data analysis for the system under test.

• Work closely with program management and other engineering departments to develop requirements, and discuss test results to include collected data and observations.

• Assist in the creation of developmental test plans, test cards, technical updates and test reports.

• Conduct ground and flight testing at private and government-owned test ranges.

• Work in a safe manner in accordance with established operating procedures and standard practices.

Requirements

• A bachelor's degree in engineering or a related technical discipline from an accredited institution. May substitute equivalent engineering experience in lieu of education.

• 5+ years of experience as test conductor/director for developmental aircraft, weapons, or missile systems.

• Must have a good understanding of engineering concepts, principles, codes, and theory; experience demonstrating a broad application of those concepts; and expanding knowledge of principles, concepts, theory, and practices in related technical specialties.

• Test engineering experience working with developmental weapon or missile systems on manned and/or unmanned aircraft to include requirements development, planning, execution, and reporting.

• Previous experience with and/or current working knowledge of MIL-STD-8591, MIL-STD-2088, MIL-STD-1553, MIL-STD-1760, AS8775, AS5653, etc.

• Experience integrating and conducting test with suspension, arming, and release equipment.

• Previous expertise and working knowledge of the National Airspace System and UAS operating rules and regulations thereof.

• Must possess the ability to understand new concepts quickly; apply them accurately; organize, schedule, and coordinate work phases; and, determine the appropriate approach at the task level or, with assistance, at the project level to provide solutions to a range of complex problems.

• Strong computer and documentation experience.

• Must have strong communication (written and verbal) and interpersonal skills.

• Ability to work independently and as part of a team; able to perform complex tasks in one or more engineering areas.

• Able to work extended hours as required.

• Ability to travel as required for test planning and execution.

• Bias for action – if you see a problem, you want to solve and fix it.

• Ability to obtain and maintain a U.S. Top Secret-Level security clearance.

Preferred Requirements

• Experience working with the Department of Defense (DoD).

• Prior experience with software code/script building using programming languages such as Go, Java, C++, Python, JavaScript, etc.

• Prior experience with Linux based systems and command line.

• Working Knowledge with COTs Small UAS autopilot and mission planning software.

• Experience working with manned aircraft personnel and familiar with aviation terminology.

• Experience with weapon or tactical datalinks.

• Experience with multiple different propulsion systems to include air and non-air breathing.

XML job scraping automation by YubHub