The Ring Blink Customer Service (RBCS) team's application complexity has grown significantly, now serving thousands of external users 24/7 across multiple integrated platforms. We're rapidly deploying AI across voice, chat, and self-service channels, but our AI capabilities ship faster than we can validate them manually, creating a critical gap in our quality assurance process. The current testing team is overwhelmed with manual testing efforts, causing delays in release cycles and increasing the risk of production issues. Key challenges include managing multiple parallel releases, ensuring comprehensive integration testing across four major systems, maintaining high availability requirements (99.9% uptime), and meeting strict security compliance standards. We are seeking a Software Development Engineer in Test to establish and own the automated quality layer using AccelQ and other Amazon internal test automation tools, enabling us to ship AI features with confidence instead of slowing down to manually test every model change. This role will implement robust automation frameworks, conduct thorough integration testing, and ensure quality across all platforms. Without this crucial hire, we risk increased production incidents, delayed AI feature releases, customer dissatisfaction, team burnout, and technical debt accumulation. This role will be instrumental in supporting our business objectives of maintaining high system reliability, ensuring secure transactions, and enabling faster time to delivery of new AI-powered features.
Key job responsibilities
Key job responsibilities
The successful Software Development Test Engineer will be obsessed with customer experience and quality improvement. In this role, you will:
Code Development & Delivery
Write secure, stable, testable, maintainable code that consistently meets high quality standards
Apply best practices in all aspects of software development and testing
Test Automation & Framework Development
Design, develop, and execute comprehensive test automation frameworks using AccelQ and Amazon internal test automation tools for web applications, APIs, and integrated systems
Build scalable test automation solutions for Salesforce Lightning components, Amazon Connect flows, AI services, and AWS service integrations
Use technology to validate and verify software, seeking input from team members on the best software test techniques to utilize
Develop custom testing tools and utilities that enable the team to efficiently validate complex AI-powered workflows
Create reusable test libraries and patterns that accelerate test development across the organization
Establish automated validation pipelines for AI model outputs, conversation flows, and intent recognition accuracy
Quality Transformation & Process Improvement
Dive deep into testing methodologies to transform manual quality processes into highly automated quality solutions, specifically targeting AI validation bottlenecks
Improve your team's automation of development, testing, and deployment processes using Amazon's internal testing ecosystem
Design, develop, and execute automation test plans and reporting on test execution
Coordinate test approaches, test cases, and test methodology with remote teams
Drive continuous improvement in test coverage from current 65% to target 90%, with focus on AI-critical paths
Transform manual AI testing processes into highly automated, reliable quality gates
Integration & End-to-End Testing
Own the end-to-end testing strategy across Salesforce, Amazon Connect, AI services, and AWS platforms
Design and execute integration test suites that validate data flow and business logic across system boundaries
Implement API testing frameworks for RESTful services and AWS service integrations
Validate AI model outputs and ensure quality of AI-powered customer service features
Automate the validation of modern user interfaces and cloud infrastructures
Build automated testing for conversational AI flows, including edge cases and error scenarios
Performance & Security Testing
Conduct performance testing and capacity planning for high-traffic customer service applications and AI services
Implement load testing strategies to validate system behavior under peak conditions, including AI service performance
Implement security testing practices and validate compliance with Amazon security standards
Establish performance benchmarks and regression testing for critical user journeys
Create performance testing frameworks for AI services under varying load conditions
Team Collaboration & Mentorship
Communicate technical concepts and processes using clear, simple language and visuals
Collaborate with development teams to shift testing left and implement test-driven development practices
Work in Agile/Scrum development methodologies with cross-functional teams
Collaborate with AI/ML teams to implement test-driven AI development practices
- 3+ years of non-internship professional software development testing experience
- Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design
- Experience in penetration testing and exploitability-focused vulnerability assessment
- Experience in platform-level security mitigations and hardening for Linux and Windows
- 1+ years of test automation frameworks and tools building experience
- 4+ years of test automation frameworks and tools building experience
- Knowledge of at least one object-oriented language (e.g., Java, Python)
- Familiar with software engineering best practices for the full software development life cycle
- Familiar with software test techniques and strategy
- Familiarity with CI/CD frameworks, processes and tools for continuous testing and integration
- Experience with both on-premises and cloud-based testing environments, preferably including AWS services
- Knowledge of overall system architecture, scalability, reliability, and performance in a database environment
- Experience with security in service-oriented architectures and web services
- Experience with test automation framework or tools (e.g., Junit, TestNG, Selenium)
- Experience with AccelQ or similar enterprise test automation platforms
- Familiarity with Amazon internal test automation tools and testing frameworks
- Knowledge of industry standard test automation tools and experience developing product test frameworks
- Knowledge of scripting languages (bash, python, etc.)
- Experience with open source tools and resources
- Experience automating the validation of modern user interfaces and infrastructures
- Experience communicating technical concepts and processes using clear, simple language and visuals
- Experience in Agile or Scrum software development methodologies
- Experience with Salesforce testing (Apex, Lightning Web Components, Salesforce APIs)
- Familiarity with Amazon Connect or contact center platforms
- Experience testing AI/ML systems and validating model outputs
- Experience with AI model monitoring, A/B testing frameworks, and automated performance validation
- Experience building quality gates for rapid AI deployment pipelines using enterprise automation tools
- Knowledge of AI safety testing, bias detection, and automated compliance validation
- Familiarity with CI/CD frameworks, processes, and tools for continuous testing and integration
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, CA, Hawthorne - 143,700.00 - 194,400.00 USD annually
