Shape Testing Strategy for AI-Native Products

• Design and own end-to-end test strategies,automated and manual,for products that integrate LLMs, generative AI, and complex data pipelines.
• Develop novel evaluation frameworks for LLM output quality, prompt regression testing, and RAG retrieval accuracy.
• Select, implement, and continuously improve testing tools and frameworks in collaboration with engineering leadership and platform excellence teams.
• Drive a measurable shift from manual to automated testing, with clear metrics to track progress.

Own Quality and Release Readiness

• Be the single point of accountability for testing across all releases of your two products.
• Build and maintain automation frameworks and scripts that keep pace with rapid release cycles.
• Analyse test results, spot trends, and turn data into actionable improvements,not just reports.
• Prepare release-readiness documentation and quality artifacts that satisfy both internal stakeholders and GxP compliance requirements.

Lead, Coach, and Build Culture

• Partner with engineering managers, scrum masters, and delivery leads across squads and geographies to establish a shared quality vision.
• Lead external contract test engineering squads by influence,setting standards, mentoring team members, and modelling engineering excellence.
• Champion a quality-engineering mindset: everyone ships quality, not just the test team.
• Stay hands-on,write test cases, debug failures, and pair with engineers when the situation calls for it.

Essential Skills and Experience

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or a related field (or equivalent practical experience).
• 10+ years of hands-on software test engineering experience across the full stack (UI, API, data).
• Proven ability to lead test strategy and mentor other test engineers,whether through formal management or technical leadership.
• Strong automation skills with modern frameworks such as Playwright, Selenium, or Cypress, plus scripting fluency in Python or a comparable language.
• Solid experience with REST API testing, database validation (PostgreSQL, MongoDB, or similar), and CI/CD-integrated test pipelines.
• A data-driven approach to quality: you define metrics, instrument dashboards, and use evidence to drive decisions.

Highly Preferred

• Experience testing AI/ML-powered products,especially LLM evaluation, prompt testing, RAG validation, or output-quality benchmarking.
• Familiarity with GxP software validation, computerised system validation (CSV), or regulated-industry quality practices.
• Background in life sciences, health-tech, or clinical-trial technology.
• Experience working with geographically distributed teams and external vendor squads.

If you're looking for a role where deep test engineering craft meets the frontier of AI,and where your work genuinely improves patient outcomes,this is it.

XML job scraping automation by YubHub

Develop and execute manual and automated test plans, test cases, and test scripts for Software & Firmware products. Perform thorough functional, regression, and user acceptance testing Identify, document, and track software/firmware defects Collaborate with developers to debug issues and verify fixes Contribute to continuous improvement of testing methodologies

Bachelor's degree in Computer Science, Engineering, or related field 3+ years of experience in software quality assurance Familiarity with agile development methodologies Testing in Linux and Windows environment Attention to detail and ability to work in a fast-paced environment Experience with Git and common platforms like Github or Bitbucket Experience with bug tracking systems (e.g., JIRA, Bugzilla) Strong debugging, analytical and creative problem-solving skills Excellent communication and teamwork abilities Aptitude for learning, Good documentation skills Ability to adapt & contribute to changing priorities. Eligible to obtain and maintain an active U.S. Secret security clearance

Basic proficiency in Python Familiarity of automated testing frameworks such as Pytest Automated UI testing tools like Playwright or Selenium is a plus. Backend testing experience

US Salary Range $113,000-$149,000 USD

XML job scraping automation by YubHub

The position is responsible for building, maintaining, and implementing automated and manual tests, collaborating closely with Agile teams, and improving overall test reliability, coverage, and efficiency across UI, API, and end-to-end workflows.

Key responsibilities include:

• Building, developing, and maintaining comprehensive automation test strategies, test plans, and test cases for Salesforce applications.
• Strengthening the Salesforce quality engineering capability by crafting and implementing scalable, enterprise-grade automation frameworks that support reliable and predictable releases.
• Building, improving, and maintaining automation solutions using Java, Selenium WebDriver, and Cucumber BDD to ensure comprehensive test coverage across UI, business workflows, and integrations.
• Automating test suites into our CI/CD pipelines using GitHub Actions and DevOps standard methodologies, enabling continuous testing and accelerating time to market.
• Validating sophisticated Salesforce business processes and user experiences through structured functional and automated testing strategies that support operational perfection.
• Ensuring robust system integrations by implementing API automation using REST Assured and conducting endpoint validation through Postman.
• Applying strong testing fundamentals,including regression optimization, defect workflow management, risk-based test development, and RCA,to continuously elevate product quality.
• Collaborating with Engineering, Product, and DevOps teams to embed quality throughout the software development lifecycle and support scalable digital transformation initiatives.

Requirements include:

• 3-5 years of dynamic experience in Automation Quality Assurance, with hands-on expertise in Salesforce testing and validation of critical business workflows.
• Strong proficiency in Java and confirmed experience building and maintaining scalable automation frameworks using Selenium WebDriver and Cucumber BDD.
• Practical experience integrating automated test execution within CI/CD environments, preferably GitHub Actions, along with a confirmed understanding of DevOps pipeline configuration.
• Strong experience in API testing using REST Assured and Postman, with the ability to validate service reliability and integration stability.
• Shown understanding in software testing principles, including test strategy development, regression planning, defect lifecycle management, and root cause analysis.
• Experience using JIRA or similar tools for defect tracking, reporting, and quality metrics clarity.
• Strong written and verbal communication skills in English and collaborate successfully within multi-functional, globally distributed teams.

Most importantly, you bring a quality-first demeanor, a dedication to continuous improvement, and to operate with ownership, accountability, and a focus on delivering high-impact, scalable solutions.

XML job scraping automation by YubHub

We are looking for an experienced Staff Software Engineer in Test to join our Identity Management Engineering (IDM) team serving the Privileged Access Team (PAM).

This team is responsible for delivering sophisticated backend solutions that help Okta reliably operate at large scale and be highly available.

As part of the team, you’ll be ensuring projects are completed with the highest quality and reliability using automation at every level for fast, robust and secure releases.

Responsibilities

• Review requirements and design specs to develop relative test plans and test cases
• Automate API tests, end-to-end tests, reliability/scale tests
• Work with engineering management to scope and plan engineering efforts
• Communicate and document QE plans for scrum teams to review
• Review application code, identify bug and other areas of weakness, architect tools for future coverage
• Automate all critical features to maintain zero-debt cadence
• Release features with solid quality
• Respond to production issues/alerts and customer issues during on-call rotation
• Be a strong customer advocate with a strong quality DNA

Requirements

• 5+ years of QE experience preferably in an enterprise SaaS company
• 3+ years experience in quality engineering for enterprise level software.
• 5+ years of experience in Python/Java-based automation development
• Familiarity with - Selenium, TestCafe, Postman, Jmeter, Locust, Splunk, AWS, Kubernetes
• Expertise in test planning and cross team collaborative efforts.
• Experience working with distributed systems at large scale
• Able to write and review designs and code with other team members
• Able to deliver well-designed high-quality code on time
• Experience with non HTTP-based protocols (SSH, RDP, TLS, LDAP, etc)
• Experience with networking (IP addressing, routing, firewalls)
• Experience with Performance testing is a huge plus

Additional Requirements

• This position requires the ability to access federal environments and/or have access to protected federal data. As a condition of employment for this position, the successful candidate must be able to submit documentation establishing U.S. Person status (e.g. a U.S. Citizen, National, Lawful Permanent Resident, Refugee, or Asylee. 22 CFR 120.15) upon hire.

XML job scraping automation by YubHub

We are seeking an automation testing engineer to join our team in Shenzhen, China. As an automation testing engineer, you will be responsible for testing software products, including web and mobile applications, to ensure they meet high quality standards.

Responsibilities

• Test software products, including web and mobile applications, to ensure they meet high quality standards.
• Write and execute automation testing scripts to improve testing efficiency and coverage.
• Use Postman, RestAssured, or other tools to validate APIs.
• Use JIRA or similar tools to record and track defects.
• Design and execute test cases, test scenarios, and regression tests.
• Collaborate with development teams, product managers, and designers to ensure software quality.
• Perform performance and security testing as needed.

Requirements

• Have experience in manual and automation testing.
• Familiar with testing methods, test case design, and defect tracking.
• Have experience in testing web and mobile applications.
• Familiar with automation testing tools such as Selenium, Cypress, or Appium.
• Familiar with API testing using Postman, RestAssured, or other tools.
• Understand CI/CD processes and can integrate testing into development workflows.
• Have good English communication skills (written and spoken).
• Currently reside in Shenzhen or surrounding areas and can travel to Hong Kong as needed.

Preferred Skills

• Have experience in performance testing and security testing.
• Familiar with programming languages such as Python, Java, or JavaScript.
• Have experience in remote team collaboration and working with cross-time zone teams.

XML job scraping automation by YubHub

Responsibilities:

• Develop, document, and execute comprehensive test plans and test cases for various software applications.
• Identify, record, and track bugs and defects in a systematic manner.
• Work with the development team to reproduce issues, identify root causes and suggest solutions.
• Perform various types of testing, including functional, regression, integration, and performance testing.
• Participate in requirement gathering sessions and provide insights to improve product quality.
• Ensure compliance with quality assurance standards and best practices.
• Continuously assess existing testing processes and recommend improvements.
• Assist in the development of automation testing scripts where applicable.

Requirements:

• Proven experience in a Quality Assurance role, preferably in the software development industry.
• Strong understanding of the software development lifecycle and testing methodologies.
• Experience with test case design, execution, and bug tracking tools (e.g., JIRA, Bugzilla).
• Familiarity with automation testing frameworks and tools (e.g., Selenium, Cypress) is a plus.
• Solid analytical and troubleshooting skills with attention to detail.
• Excellent written and verbal communication skills to clearly convey quality-related issues.
• A degree in Computer Science, Information Technology, or a related field is preferred.
• Strong teamwork and collaboration skills to work effectively with developers and product managers.

Benefits:

• 31 days of annual leave per year (inc. national holidays)
• Health and Dental Insurance
• HKD$10,000 L&D allowance per year
• Regular team socials (office and out of office)
• Great office locations

XML job scraping automation by YubHub

Your primary goal will be to identify bugs, ensure compliance with industry standards, and improve the user experience across our platforms. You will collaborate closely with developers and product managers to understand requirements, create test cases, execute tests, and provide feedback to stakeholders. Strong attention to detail and a commitment to delivering high-quality products are essential for this position.

Responsibilities

• Develop, document, and execute comprehensive test plans and test cases for various software applications.
• Identify, record, and track bugs and defects in a systematic manner.
• Work with the development team to reproduce issues, identify root causes and suggest solutions.
• Perform various types of testing, including functional, regression, integration, and performance testing.
• Participate in requirement gathering sessions and provide insights to improve product quality.
• Ensure compliance with quality assurance standards and best practices.
• Continuously assess existing testing processes and recommend improvements.
• Assist in the development of automation testing scripts where applicable.

Requirements

• Proven experience in a Quality Assurance role, preferably in the software development industry.
• Strong understanding of the software development lifecycle and testing methodologies.
• Experience with test case design, execution, and bug tracking tools (e.g., JIRA, Bugzilla).
• Familiarity with automation testing frameworks and tools (e.g., Selenium, Cypress) is a plus.
• Solid analytical and troubleshooting skills with attention to detail.
• Excellent written and verbal communication skills to clearly convey quality-related issues.
• A degree in Computer Science, Information Technology, or a related field is preferred.
• Strong teamwork and collaboration skills to work effectively with developers and product managers.

Benefits

We're a fast-growing company within a rapidly developing industry. You'll be surrounded by super ambitious individuals who think really big.

• What we offer:
• 31 days of annual leave per year (inc. national holidays)
• Health and Dental Insurance
• HKD$10,000 L&D allowance per year
• Regular team socials (office and out of office)
• Great office locations

XML job scraping automation by YubHub

This is a unique role that bridges the gap between QA and DevOps. You'll help:

• Coordinate and support teams performing system test functions
• Design and execute test solutions that cut across squads and technologies
• Create and execute Integration Test Plans
• Contribute to Integration test automation suites
• Execute cloud-based multi-server deployments using tools like Octopus
• Monitor product observability using tools such as DataDog
• Perform static analysis to identify risks in missions

About you

• A quality champion with strong ownership
• Expertise in manual and automation testing across multiple technologies
• Strong communication skills
• A collaborative mindset, able to build and maintain good professional relationships across the company
• Proven experience with automation tools, including exposure to C#/.NET, Selenium, etc...
• Basic understanding of SQL
• Knowledge of defect tracking and test management systems
• Familiarity with observability tooling such as Prometheus, DataDog, etc...
• Basic project management skills
• Exposure to DevOps in a cloud environment will be advantageous
• Curiosity, passion, and energy

This is a hybrid role with a home / office-based split, requiring regular (1-2 days per week) attendance in the Cape Town office. We are only considering applicants with an existing right to work in South Africa, without the need for employer sponsorship.

Benefits

• Rest & Relax Fridays
• Finish at lunch time on Friday but get paid for the full day
• Annual volunteer day
• Employee Rewards and Benefits with Perkbox
• Compulsory Defined Contribution Company Pension Scheme
• Medical Insurance / Medical Aid (after qualifying period)
• Employee Assistance Programme Service
• Paid Sick leave
• 5 days bereavement leave per year
• On-Site Breakfast Bar

XML job scraping automation by YubHub

Helpshift is looking for a skilled Software Tester to join our team. As a Software Tester, you will work on projects that impact our conversations with consumers, bringing maximum value to them.

About the Team

At Helpshift, we have a QA Guild established which is responsible for performing QA for all projects that are executed across the organisation. The QA guild collaborates with engineering, product and design teams on implementation and user scenarios.

Role Details

Key Responsibilities

• Design Test Plans, Test Specifications and Test Cases for Product features.
• Take ownership of feature testing and drive to completion.
• Identify challenges, risks and provide test estimates for feature testing.
• Execute regression test suites.
• Perform exploratory testing.
• Driving and maintaining the automation test suites.
• Maximize test coverage for the most critical features of the system using automation.

Requirements

• 3+ years of experience in software testing and engineering.
• Proficiency in one of the programming/scripting languages (Java/JS).
• Hands on experience in version control systems like Git or SVN.

Benefits

• Hybrid setup.
• Worker's insurance.
• Paid Time Offs.
• Other employee benefits to be discussed by our Talent Acquisition team in India.

XML job scraping automation by YubHub

At Microsoft AI, we deliver exceptional products and services that empower users to be more productive and efficient.

In this role, you will work across all four stages of our evaluation platform: data sampling, AI data collection and processing, data analysis and evaluation, and insight generation.

You will contribute across the full stack—from backend databases and middle-tier services to browser automation, statistical analysis, and dashboard creation.

Expect to dive into prompt engineering and leverage cutting-edge AI tools to drive meaningful impact.

This engineering position offers exposure to a wide range of technologies and surfaces, including desktop, web, and mobile.

You will collaborate closely with teams across Microsoft AI to assess Copilot’s relevance, performance, trustworthiness, and visual appeal.

Our platform supports desktop and mobile automation and UX studies—enabling scenarios like multi-turn conversations with voice input on iOS and Android apps.

The possibilities are endless.

Responsibilities:

• Expertise in experimentation methodologies, including A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis.

• Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.

• Designing pipeline architecture to ensure rapid iteration and scalability.

• Conducting post-analysis of labeled data and developing dashboards to visualize insights.

• Collaborating closely with the product team to enhance quality and address gaps.

Qualifications:

• Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, or Python OR equivalent experience.

• 2+ years’ experience with SQL, PostgreSQL or MySQL

• 2+ years’ experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.

• Extensive use datastores like RDBMS, key-value stores, etc.

• Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code

• HTML, CSS, JavaScript, ASP.NET, REST, jQuery

• Familiarity with browser automation tools like Selenium, Puppeteer or Playwright

• Familiarity with mobile automation tools like Appium

• Familiarity with LLMs and AI ChatBots Prompt Engineering

• Azure DevOps, GIT

• Azure Open AI, Azure Foundry

• Experience in leading technical projects and supporting architectural decisions with data.

Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year.

There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.

Certain roles may be eligible for benefits and other compensation.

Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

XML job scraping automation by YubHub

Microsoft AI are looking for a talented Member of Technical Staff - Full Stack Software Engineer to help build the next wave of capabilities for their personalized AI assistant, Copilot. At Microsoft AI, they push boundaries to deliver exceptional products and services that empower users to be more productive and efficient.

About the Role

In this role, you will work across all four stages of their evaluation platform: data sampling, AI data collection and processing, data analysis and evaluation, and insight generation. You will contribute across the full stack—from backend databases and middle-tier services to browser automation, statistical analysis, and dashboard creation. Expect to dive into prompt engineering and leverage cutting-edge AI tools to drive meaningful impact. This engineering position offers exposure to a wide range of technologies and surfaces, including desktop, web, and mobile.

Accountabilities

• Expertise in experimentation methodologies, including A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis.
• Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.
• Designing pipeline architecture to ensure rapid iteration and scalability.
• Conducting post-analysis of labeled data and developing dashboards to visualize insights.
• Collaborating closely with the product team to enhance quality and address gaps.

The Candidate we're looking for

Experience:

• 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, or Python.

Technical skills:

• SQL, PostgreSQL or MySQL.
• Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code.
• HTML, CSS, JavaScript, ASP.NET, REST, jQuery.

Personal attributes:

• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.

Benefits

• Competitive salary.
• Comprehensive benefits package.
• Opportunities for professional growth and development.
• Collaborative and dynamic work environment.

XML job scraping automation by YubHub

What you'll do

As a Senior Software Automation Testing Engineer, you will be responsible for designing, developing, and maintaining efficient automated test scripts to ensure software stability and quality. You will also build and optimize test automation frameworks to enhance maintainability and scalability.

• Design, develop, and maintain efficient automated test scripts to ensure software stability and quality.
• Build and optimize test automation frameworks to enhance maintainability and scalability.

What you need

• Bachelor’s degree or higher in Computer Science or a related field.
• Proficiency in at least one programming language, such as Python, Java, or C#, with strong coding best practices.
• Hands-on experience with test automation tools such as Selenium, Appium, or JUnit.

XML job scraping automation by YubHub