Top 9040 Software Test Architect Jobs

Lead Software Test Automation Engineer | Test Architect - Agentic AI
Wolters Kluwer —Coppell, TX
- $89,600 - $157,000 a year
- Full-time
- Java
- JavaScript
- Mentoring
- Commuter assistance
- Paid parental leave
Electrical Engineer III - Communications
OTTO Engineering —Carpentersville, IL
- $90,000 - $105,000 a year
- Online Application
- Customer service
- 5 years
- Senior level
- Profit sharing
- Health savings account
12d
CONSTRUCTION PROJECT COORDINATOR & ESTIMATOR
Confidential —McLean, VA
- $65,000 - $120,000 a year
- Urgently hiring
- Carpentry
- 7 years
- Construction site
- Cell phone reimbursement
Quick Apply
Senior Systems Security Engineer
Modern Technology Solutions, Inc —Huntsville, AL
- Full-time
- Computer science
- Computer Science
- 11+ years
- Disability insurance
- Health insurance
Lead Software Engineer, Data & DevSecOps
Leidos —Arlington, VA
- $131,300 - $237,350 a year
- Full-time
- Java
- SQL
- Bachelor's degree
Sr. Software Engineer
CentralReach —Holmdel, NJ
- $160,000 - $180,000 a year
- Full-time
- 5 years
- AWS
- Senior level
- Paid parental leave
- Health insurance
Quick Apply
Senior PHP / Laravel Engineer
Lendzi —Boca Raton, FL
- From $75,000 a year
- Full-time
- Hybrid work
- 7 years
- Office
- Senior level
- Health insurance
- Dental insurance
Quick Apply
Sr. RF Test Systems Development Engineer, Avionics Verification and Test, Amazon Leo
Amazon Kuiper Manufacturing Enterprises LLC —Redmond, WA
- $137,300 - $185,700 a year
- Full-time
- 3 years
- Presentation skills
- Senior level
- AD&D insurance
- Health insurance
5d
Strategic Account Manager
Schmidt-Goodman Office Products, Inc. —Rochester, MN
- $65,000 - $80,000 a year
- Full-time
- Background check
- Microsoft Excel
- Up to 50% travel
- Health savings account
- Health insurance
Quick Apply
Platform DevSecOps Engineer (US citizen/Secret Clearance Required)
IvoryCloud —Rockville, MD
- $155,000 - $185,000 a year
- Full-time
- Hybrid work
- Computer Science
- System design
- Research
- Health insurance
- Dental insurance
Quick Apply
9d
Plumbing Inspector
Antrim County —Bellaire, MI
- $27.90 - $28.70 an hour
- Full-time
- Hybrid work
- Carpentry
- Background check
- Construction site
- Health insurance
- Dental insurance
Quick Apply
Construction Superintendant
Ruckle Construction —San Diego, CA
- $93,600 - $104,000 a year
- Full-time
- Microsoft Excel
- Microsoft Outlook
- Construction site
- Health insurance
- Dental insurance
Quick Apply
Lead Backend Engineer (API Architect)
CMB Regional Centers —Rock Island, IL
- $127,300 - $170,000 a year
- Full-time
- Computer science
- Computer Science
- 8 years
Lead Systems Integration Engineer #554
Photo-Sonics, Inc. —Chatsworth, CA
- $72 - $86 an hour
- Urgently hiring
- Bachelor of Science
- Research
- Master's degree
- Health savings account
- Health insurance
Quick Apply
Financial Systems Architect-OneStream Architect
A.O. Smith —Nashville, TN
- Full-time
- Hybrid work
- Residential
- Finance
- Bachelor's degree
- Disability insurance
- Health insurance
Quick Apply
Senior Software Engineer - Java/J2EE
Unum Group —Chattanooga, TN
- $89,400 - $183,500 a year
- Full-time
- Computer science
- 6 years
- Computer Science
- Disability insurance
- Health insurance
Cloud Engineer
SS&C Technologies —Kansas City, MO
- Full-time
- Hybrid work
- Research
- Mid-level
- Continuous improvement
- Paid holidays
- Health insurance
Construction Project Manager
Brick and Bond —Casper, WY
- Full-time
- Background check
- Microsoft Excel
- Microsoft Outlook
- Profit sharing
- Paid holidays
Quick Apply
Systems Security Engineer
Modern Technology Solutions, Inc —Wright-Patterson AFB, OH
- Computer Science
- 5 years
- Bachelor of Science
- Disability insurance
- Health insurance
Senior Staff / Senior Cloud Engineer
SciTec —Dayton, OH
- $114,000 - $174,000 a year
- Full-time
- Computer Science
- 5 years
- System design
- Profit sharing
- Paid parental leave
Quick Apply

I want to receive the latest job alert for Software Test Architect

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

Software Test Architect jobs near

PHP Engineer jobs in Boca Raton, FL

Senior Software Engineer jobs in Holmdel, NJ

Construction Superintendent jobs in San Diego, CA

Senior Staff Engineer jobs in Dayton, OH

Cloud Engineer jobs in Kansas City, MO

Software Engineer jobs in Arlington, VA

Security Systems Engineer jobs in Wright-Patterson AFB, OH

Senior Rf Engineer jobs in Redmond, WA

Account Manager jobs in Rochester, MN

Platform Engineer jobs in Rockville, MD

Php Engineer jobs in Irvine, CA

Php Engineer jobs in Philadelphia, PA

Devops Engineer jobs in Portland, OR

Php Engineer jobs in San Jose, CA

Engineer jobs in Arkansas

Audio Engineer jobs in Alabama

Systems Integration Engineer jobs in Kansas City, MO

Systems Integration Engineer jobs in Melbourne, FL

Systems Integration Engineer jobs in Poway, CA

Bachelors Degree In Integration Health Science jobs in Atlanta, GA

Lead Software Test Automation Engineer | Test Architect - Agentic AI

Wolters Kluwer -
Coppell, TX

Apply Now

Job Details

Full-time
$89,600 - $157,000 a year

Benefits

Commuter assistance
Paid parental leave
Health savings account
Health insurance
Dental insurance
401(k)
Flexible spending account
Tuition reimbursement
Parental leave
Vision insurance

Qualifications

Tooling
Software coding
Accessibility testing
Scalable systems
Scalability
UI
Quality check automation
DevOps automation
Technical architecture

Full Job Description

We are seeking a Lead Test Automation Architect to define and lead an enterprise-grade test automation strategy across UI, API, data, and platform layers—while evolving our quality engineering capabilities to support Agentic AI / LLM-based systems (probabilistic outputs, confidence-based validation, hallucination detection, and model evaluation). This role will architect scalable automation frameworks, drive engineering excellence, and accelerate delivery through highly productive, maintainable automation programs.

Key Responsibilities

Automation Strategy & Architecture

Define and own the test automation architecture and multi-layer strategy (UI/API/contract/integration/e2e), aligned to product risk and release cadence.
Establish automation standards, patterns, and reference implementations (framework structure, page-object/screenplay usage, test data patterns, reporting).
Drive shift-left testing practices (contract testing, component testing, pre-merge validation) and reduce reliance on fragile end-to-end tests.

Agentic AI / LLM Test Model Alignment

Design and implement testing approaches for non-deterministic AI outputs, including:
- confidence/threshold-based assertions
- semantic similarity checks and rubric-based validation
- goldens/benchmark datasets and evaluation harnesses
- hallucination and groundedness testing strategies
- regression detection across model/prompt/version changes
Define AI test coverage across accuracy, robustness, bias/safety (as applicable), performance, and reliability.
Partner with ML/AI, Product, and Engineering to establish acceptance criteria for AI capabilities and measurable quality gates.

High-Productivity Automation Programs

Build and scale high-throughput automation projects that are reliable, fast, and easy to extend.
Improve test execution time, reduce flaky tests, and optimize CI/CD pipelines (parallelization, test selection, retries with guardrails).
Create actionable, engineering-friendly quality dashboards (pass/fail trends, flake rate, coverage, defect escape metrics).

Tooling, CI/CD, and Quality Gates

Integrate automation into CI/CD with quality gates (PR checks, nightly suites, release readiness criteria).
Standardize observability for testing: logs, tracing hooks, screenshots/video, artifacts, and test run diagnostics.
Define practices for test environments, data management, service virtualization, and dependency control.

Technical Leadership & Mentorship

Serve as the QE technical authority: coach engineers on automation design, code quality, and best practices.
Lead design reviews for test architecture and automation PRs; enforce coding standards and maintainability.
Influence roadmap and delivery by translating risk into clear testing priorities.

Required Qualifications

8–12+ years in Quality Engineering / Test Automation with architect-level ownership of frameworks and strategy.
Proven experience designing scalable automation across:
- API testing (contract + integration)
- UI automation with stable locator strategies (test IDs, accessibility roles)
- Test data strategy and environment reliability
Strong programming skills in at least one modern language (e.g., Java, Python, TypeScript/JavaScript, C#).
Expertise with automation tools/frameworks (examples):
- UI: Playwright / Cypress / Selenium
- API: REST-assured / SuperTest / Postman/Newman / pytest
- CI: GitHub Actions / Jenkins / Azure DevOps
Demonstrated ability to reduce flakiness and improve execution speed through engineering solutions.

Preferred Qualifications (Strongly Desired)

Experience testing LLM/Agentic AI features or other probabilistic systems, including:
- evaluation harnesses, benchmark datasets, semantic scoring, and drift detection
- prompt/version regression strategies and structured evaluation reports
Familiarity with modern quality approaches: test pyramid, contract testing, consumer-driven contracts, risk-based testing, shift-left.
Knowledge of security/performance testing integration (baseline understanding; hands-on is a plus).
Experience building reusable automation libraries for multiple teams/products.

Our Interview Practices

To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.

Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.

Compensation:

$89,600.00 - $157,000.00 USD

This role is eligible for Bonus.

Compensation range listed is based on primary location of the position. Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process.

Additional Information:

Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request.

Apply Now

Refine Your Search

Software Test Architect jobs

I want to receive the latest job alert for Software Test Architect

Related Searches

Explore jobs in more locations

Key Responsibilities

Automation Strategy & Architecture

Define and own the test automation architecture and multi-layer strategy (UI/API/contract/integration/e2e), aligned to product risk and release cadence.

Establish automation standards, patterns, and reference implementations (framework structure, page-object/screenplay usage, test data patterns, reporting).

Drive shift-left testing practices (contract testing, component testing, pre-merge validation) and reduce reliance on fragile end-to-end tests.

Agentic AI / LLM Test Model Alignment

Design and implement testing approaches for non-deterministic AI outputs, including:

confidence/threshold-based assertions

semantic similarity checks and rubric-based validation

goldens/benchmark datasets and evaluation harnesses

hallucination and groundedness testing strategies

regression detection across model/prompt/version changes

Define AI test coverage across accuracy, robustness, bias/safety (as applicable), performance, and reliability.

Partner with ML/AI, Product, and Engineering to establish acceptance criteria for AI capabilities and measurable quality gates.

High-Productivity Automation Programs

Build and scale high-throughput automation projects that are reliable, fast, and easy to extend.

Improve test execution time, reduce flaky tests, and optimize CI/CD pipelines (parallelization, test selection, retries with guardrails).

Create actionable, engineering-friendly quality dashboards (pass/fail trends, flake rate, coverage, defect escape metrics).

Tooling, CI/CD, and Quality Gates

Integrate automation into CI/CD with quality gates (PR checks, nightly suites, release readiness criteria).

Standardize observability for testing: logs, tracing hooks, screenshots/video, artifacts, and test run diagnostics.

Define practices for test environments, data management, service virtualization, and dependency control.

Technical Leadership & Mentorship

Serve as the QE technical authority: coach engineers on automation design, code quality, and best practices.

Lead design reviews for test architecture and automation PRs; enforce coding standards and maintainability.

Influence roadmap and delivery by translating risk into clear testing priorities.

Required Qualifications

8–12+ years in Quality Engineering / Test Automation with architect-level ownership of frameworks and strategy.

Proven experience designing scalable automation across:

API testing (contract + integration)

UI automation with stable locator strategies (test IDs, accessibility roles)

Test data strategy and environment reliability

Strong programming skills in at least one modern language (e.g., Java, Python, TypeScript/JavaScript, C#).

Expertise with automation tools/frameworks (examples):

UI: Playwright / Cypress / Selenium

API: REST-assured / SuperTest / Postman/Newman / pytest

CI: GitHub Actions / Jenkins / Azure DevOps

Demonstrated ability to reduce flakiness and improve execution speed through engineering solutions.

Preferred Qualifications (Strongly Desired)

Experience testing LLM/Agentic AI features or other probabilistic systems, including:

evaluation harnesses, benchmark datasets, semantic scoring, and drift detection

prompt/version regression strategies and structured evaluation reports

Familiarity with modern quality approaches: test pyramid, contract testing, consumer-driven contracts, risk-based testing, shift-left.

Knowledge of security/performance testing integration (baseline understanding; hands-on is a plus).

Experience building reusable automation libraries for multiple teams/products.

Our Interview Practices

Additional Information: