Top 8967 Software test architect Jobs

Lead QA Engineer
Sunflare LLC —Orlando, FL
- $85,000 - $100,000 a year
- Full-time
- Background check
- HIPAA
- Bachelor's degree
- Health insurance
- Dental insurance
Quick Apply
Financial Systems Architect-OneStream Architect
A.O. Smith —Nashville, TN
- Full-time
- Hybrid work
- Residential
- Finance
- Bachelor's degree
- Disability insurance
- Health insurance
Quick Apply
Senior Developer
BuildingReports.com —Remote
- From $100,000 a year
- Full-time
- Remote
- Background check
- Computer Science
- System design
- Health savings account
- Health insurance
Quick Apply
Test Principal Architect - onsite in Raymond, Ohio
Thomas & Reed, LLC —Carmel, IN
- Computer science
- Analysis skills
- In-person
Quick Apply
Test Principal Architect - onsite in Raymond, Ohio
Thomas & Reed, LLC —Columbus, OH
- Computer science
- Analysis skills
- In-person
Quick Apply
Software Engineer
iHealth Labs —Sunnyvale, CA
- Mid-level
- 3 years
- AWS
Quick Apply
Associate Software Developer
DarioHealth —Remote
- SQL
- Analysis skills
- Communication skills
Quick Apply
Software Engineer
INFRAPOD TECHNOLOGIES —San Jose, CA
- $98,904 - $100,000 a year
- Email
- Computer Science
- Mid-level
- Master's degree
- Health insurance
- 401(k)
Embedded Software Engineer
Concurrent Technologies —Remote
- Remote
- Mid-level
- Windows
- US work authorization
- Health insurance
- 401(k)
Software Developer
INFRAPOD TECHNOLOGIES —San Jose, CA
- $83,886 - $85,000 a year
- Email
- Computer Science
- Mid-level
- Master's degree
- Health insurance
- 401(k)
IT Software Developer III
E Logic —Washington, DC
- From $95,000 a year
- Full-time
- Computer Science
- 5 years
- Analysis skills
Quick Apply
Senior Software Engineer
Mid Continent Controls, Inc. —Derby, KS
- $94,000 - $120,000 a year
- Full-time
- 5 years
- Office
- Java
- Paid holidays
- Health insurance
Quick Apply
Lead, Engineering Excellence
Bain & Co. —Seattle, WA
- $179,875 - $203,925 a year
- Full-time
- Hybrid work
- Azure
- Computer Science
- Office
- Wellness program
- Paid holidays
Quick Apply
Expert Senior Manager, Engineering Excellence
Bain & Co. —New York, NY
- $258,425 - $293,500 a year
- Full-time
- Hybrid work
- Azure
- Management
- Computer Science
- Wellness program
- Paid holidays
Quick Apply
Lead, Engineering Excellence
Bain & Co. —Boston, MA
- $179,875 - $203,925 a year
- Full-time
- Hybrid work
- Azure
- Computer Science
- Office
- Wellness program
- Paid holidays
Quick Apply
Expert Senior Manager, Engineering Excellence
Bain & Co. —Seattle, WA
- $258,425 - $293,500 a year
- Full-time
- Hybrid work
- Azure
- Management
- Computer Science
- Wellness program
- Paid holidays
Quick Apply
Expert Senior Manager, Engineering Excellence
Bain & Co. —Austin, TX
- $258,425 - $293,500 a year
- Full-time
- Hybrid work
- Azure
- Management
- Computer Science
- Wellness program
- Paid holidays
Quick Apply
Cloud Architect
Sonsoft Inc —Plano, TX
- Full-time
- Azure
- Java
- SQL
Quick Apply
Lead, Engineering Excellence
Bain & Co. —San Francisco, CA
- $179,875 - $203,925 a year
- Full-time
- Hybrid work
- Azure
- Computer Science
- Office
- Wellness program
- Paid holidays
Quick Apply
Expert Senior Manager, Engineering Excellence
Bain & Co. —San Francisco, CA
- $258,425 - $293,500 a year
- Full-time
- Hybrid work
- Azure
- Management
- Computer Science
- Wellness program
- Paid holidays
Quick Apply

I want to receive the latest job alert for software test architect

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

software test architect jobs near

Lead QA Engineer

Sunflare LLC
Orlando, FL

Quick Apply

Job Details

Full-time
$85,000 - $100,000 a year

Benefits

Health insurance
Dental insurance
401(k)
Paid time off
Vision insurance
Flexible schedule
Life insurance

Qualifications

AI models
Software design
RESTful API
Test management tools
Selenium
Bachelor's degree

Full Job Description

Oncologic builds AI solutions for community oncology. Our cloud-native platform runs on Google Cloud Platform and uses frontier LLMs (Claude, GPT, Gemini) in a model-agnostic way to automate complex clinical workflows, from patient intake and EHR summarization to care coordination and exception detection. These products run in high-stakes clinical settings where reliability is not negotiable.

We are hiring our founding QA engineer. This is a hands-on role for someone who will personally build the test automation, define how we evaluate AI features, and set the quality bar that the QA function grows from. You will architect and write the frameworks yourself, not hand them off. As the team grows, you will shape the standards, tooling, and early hires that scale quality across the organization.

What you will own

Test automation (hands-on). Architect and build maintainable automated suites in Playwright with JavaScript or TypeScript across the web, API, and AI layers of the platform. You own the code, not only the strategy.
CI/CD quality gates. Wire automated suites into GCP-based CI/CD (Cloud Build, GitHub Actions, or equivalent) and enforce quality gates at every stage, driving functional, regression, integration, and performance coverage.
AI and LLM quality. Define and build evaluation frameworks for RAG pipelines, agentic workflows (LangGraph, CrewAI), and LLM outputs, testing for accuracy, groundedness, hallucination risk, and clinical safety against oncology-specific cases. Build repeatable regression testing as models and pipelines evolve.
Quality strategy and standards. Own the end-to-end test strategy and the KPIs that matter (defect escape rate, automation coverage, cycle time), and represent quality in architecture reviews and release decisions.
Release quality and compliance. Own release go / no-go criteria and risk sign-off, and maintain QA documentation and test records appropriate for a HIPAA-regulated environment.
Foundation and influence. Embed shift-left quality across product squads, from refinement and design through production. As QA grows, shape the standards, tooling, and mentoring for the team you help build.

Who you are

Hands-on QA depth: 7+ years in software QA with deep, current test automation experience. You still write test code and want to keep doing it.
Automation mastery: Expert with Playwright and/or Selenium WebDriver in JavaScript or TypeScript, able to architect frameworks and set the bar for test code quality.
Comfort with AI/LLM quality: You are excited to define how we test non-deterministic LLM outputs, and you can reason about evaluating accuracy, groundedness, and hallucination risk even if you have not yet built such frameworks in production.
Strategy ownership: A track record owning end-to-end test strategy across web, API, and integration layers, with automated testing wired into CI/CD quality gates.
Foundational mindset: Comfortable being the first and only QA for a stretch, building the function from scratch and setting standards others will follow.
API testing and communication: Strong REST API testing (Postman or equivalent), and the ability to translate quality metrics into a clear, actionable narrative for engineering and business stakeholders.

Nice to have

Hands-on experience building eval frameworks for RAG, agentic workflows, or LLM-as-judge in production.
Healthcare or regulated software experience (HIPAA, EHR integrations, FHIR / HL7).
Hands-on GCP (Vertex AI, Cloud Run, GKE, Cloud Build).
Test management platforms (TestRail, Zephyr, or Xray) and ISTQB Advanced or equivalent certification.
Genuine interest in oncology and the operational complexity of clinical environments.

Details: Pay range $85,000 to $100,000 per year. Travel up to 25%. Benefits include 401(k), medical, dental, and vision, flexible schedule, and paid time off.

Pay: $85,000.00 - $100,000.00 per year

Benefits:

401(k)
Dental insurance
Flexible schedule
Health insurance
Life insurance
Paid time off
Vision insurance

Application Question(s):

How many years of hands-on QA/test automation experience do you have, and have you personally architected and built test automation frameworks using Playwright or Selenium WebDriver in JavaScript or TypeScript? Please describe the scope of a framework you built.
Have you worked as the first or sole QA engineer at a company, building the testing function and standards from scratch? If yes, briefly describe what you built.
This role involves testing non-deterministic LLM/AI outputs (RAG pipelines, agentic workflows) for accuracy, groundedness, and hallucination risk. Do you have direct experience with this, or a strong conceptual understanding of how you'd approach it? Please explain
Describe your experience integrating automated test suites into CI/CD pipelines (e.g., GitHub Actions, Cloud Build) and your experience with REST API testing tools like Postman.

Education:

Bachelor's (Required)

Location:

Orlando, FL 32819 (Preferred)

Ability to Commute:

Orlando, FL 32819 (Required)

Ability to Relocate:

Orlando, FL 32819: Relocate before starting work (Preferred)

Willingness to travel:

25% (Preferred)

Work Location: In person

Quick Apply

Refine Your Search

software test architect jobs

Lead QA Engineer

Financial Systems Architect-OneStream Architect

Senior Developer

Test Principal Architect - onsite in Raymond, Ohio

Test Principal Architect - onsite in Raymond, Ohio

Software Engineer

Associate Software Developer

Software Engineer

Embedded Software Engineer

Software Developer

IT Software Developer III

Senior Software Engineer

Lead, Engineering Excellence

Expert Senior Manager, Engineering Excellence

Lead, Engineering Excellence

Expert Senior Manager, Engineering Excellence

Expert Senior Manager, Engineering Excellence

Cloud Architect

Lead, Engineering Excellence

Expert Senior Manager, Engineering Excellence

I want to receive the latest job alert for software test architect

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected