Designation: QA Engineer (Sr.) Experience: 7+ years
Role & Responsibilities:
- Define and own the end-to-end test strategy covering unit, integration, end-to-
end, performance, security, and regression testing across all system layers
- Create and maintain the QA test suite including test plans, test cases,
traceability matrices mapping tests to requirements and user stories
- Define test data requirements — work with the DBA to create
anonymized/synthetic test datasets that cover edge cases across all python
based deterministic rules, ML models, and disposition outcomes
- Establish defect triage SLAs (P1: 24 hrs, P2: 3 business days, P3: next sprint, P4:
backlog) and lead triage meetings
- Collaborate with ML Engineers to design validation test suites, test model drift
monitoring
- Security testing: Support the security review and penetration testing process.
Coordinate with external security assessors, manage remediation of findings
- Performance Testing: Design and execute performance tests validating system
can handle 1,000+ claims/day, test ML inference endpoint latency under
concurrent requests
- UAT Support: Prepare UAT environments, test data, and test scripts and
coordinate with Client’s QA/UAT Lead and end users. Capture evidences and get
UAT Sign-off
Required Skills and Experience
Must Have
- 7+ years of QA experience in Python/FastAPI backend applications with pytest
- Experience with E2E test automation for React applications using Cypress or
Playwright
- Strong SQL skills — ability to write complex queries to validate data integrity
across relational tables, verify stored procedure outputs, and validate audit log
completeness
- Experience testing REST APIs — Postman, Swagger/OpenAPI, API contract
testing, authentication/authorization testing
- Experience in writing and maintaining automated E2E test suites (Cypress or
Playwright) for React JS based UI screens:
- Experience with AWS services — ECS, Lambda, SQS, S3, Aurora, Redshift, DBT,
API Gateway (ability to read CloudWatch logs, test Lambda invocations, validate
SQS message flow)
- Defect management and triage experience using Jira — creating reproducible
bug reports, prioritizing defects, tracking resolution through sprint cycles
- Understanding of CI/CD pipelines — integrating automated tests into build
pipelines, understanding deployment gates based on test pass rates
- Experience validating ML model outputs — precision/recall metrics, confusion
matrix analysis, data drift monitoring
Good to Have
- Experience in healthcare, insurance, or FWA/claims processing domain
- HIPAA compliance testing experience — PHI access controls, encryption
validation, audit log verification
- Performance testing tools — Locust, k6, or JMeter for load/stress testing
- Security testing fundamentals — OWASP Top 10, penetration test coordination,
vulnerability scan interpretation
- PostgreSQL + PostGIS experience — spatial query testing, geospatial data
validation
- WebSocket testing experience — real-time event validation, connection stability
testing
- ISTQB or equivalent QA certification
Pay: $50.00 - $60.00 per hour
Benefits:
- Health insurance
- Paid time off
- Referral program
Work Location: Remote
