Specialist, QA Test Automation
Breezeline —Quincy, MA
- $77 an hour
- Full-time
- Computer science
- Computer Science
- Software troubleshooting
7d
QA Analyst
Magellan Jets —Quincy, MA
- $85,000 - $115,000 a year
- Full-time
- 7 years
- Computer Science
- Office
- Paid holidays
- Health insurance
Quick Apply
QA Engineer
Grand Circle LLC —Boston, MA
- $90,000 - $100,000 a year
- Hybrid work
- Mid-level
- SQL
- Analysis skills
- Commuter assistance
- Paid holidays
Quick Apply
7d
Software QA Automation
eInfochips —Boston, MA
- 6 years
- Laboratory experience
- Travel
Quick Apply
QA Analyst
enLabel Global Services, Inc —Boston, MA
- Computer science
- Computer Science
- Mid-level
Sr Software QA Engineer
West Technology Group —Woburn, MA
- $100,000 - $120,000 a year
- Full-time
- Hybrid work
- Computer Science
- Mid-level
- Office
- Work from home
7d
Senior QA Engineer I
Flywire —Boston, MA
- $100,000 - $135,000 a year
- Full-time
- Hybrid work
- Computer Science
- Writing skills
- System design
- Employee stock purchase plan
Quick Apply
Quality Assurance Engineer II
CarGurus —Boston, MA
- $96,000 - $120,000 a year
- Hybrid work
- Software troubleshooting
- Engineering
- Mid-level
- Food provided
8d
Senior Software Engineer
eClinical Solutions —Mansfield, MA
- $132,000 - $165,000 a year
- Remote
- Computer science
- Azure
- Computer Science
Quick Apply
Software Quality Assurance Engineer (Entry-Level), Windows Connector
Realtime Robotics —Boston, MA
- Full-time
- Hybrid work
- Computer science
- Computer Science
- Software troubleshooting
- Health savings account
- Health insurance
Quick Apply
QA Developer
Xicay Technologies —Boston, MA
- Full-time
- Software troubleshooting
- English
- Mid-level
Systems Administrator Quality Assurance
Starfish Storage Corporation —Waltham, MA
- $125,000 - $185,000 a year
- Full-time
- Remote
- Background check
- 7 years
- Azure
- Paid holidays
- Disability insurance
Quick Apply
Guidewire QA Engineer – InsuranceNow
Cognizant —Boston, MA
- $71,100 - $112,500 a year
- Full-time
- Remote
- Mid-level
- SQL
- US work authorization
- Paid holidays
- Disability insurance
5d
Quality Assurance Manager
Plymouth Rock Assurance Corporation —Boston, MA
- $130,000 - $165,000 a year
- Computer Science
- DevOps
- Master's degree
Quick Apply
QA Automation Engineer (Mobile) - Boston, MA
Two95 International Inc. —Boston, MA
- Contract
- Mid-level
- Analysis skills
- Leadership
Quick Apply
QA Automation Engineer
Syndic8 DMS —Boston, MA
- Full-time
- Mid-level
- 3 years
- Commuter assistance
- Paid holidays
QA Test Engineer
OnPage —Waltham, MA
- Computer science
- Computer Science
- Mid-level
- Paid holidays
- Disability insurance
Automation Software Development Engineer
Philips —Cambridge, MA
- $128,000 - $205,000 a year
- Full-time
- Computer Science
- Mid-level
- Office
- Health savings account
- Employee stock purchase plan
Software Engineer I (Quality)
WHOOP —Boston, MA
- $105,000 - $145,000 a year
- Full-time
- Computer science
- Computer Science
- Office
Cloud Application Tester - Mid
Applied Information Sciences —Boston, MA
- $77,000 - $117,000 a year
- Full-time
- Computer Science
- Mid-level
- Bachelor's degree

I want to receive the latest job alert for software qa automation in quincy ma

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

software qa automation jobs near quincy ma

Quality Assurance Analyst jobs in Boston, MA

Software Test Engineer jobs in Boston, MA

Software Engineer jobs in Cambridge, MA

Quality Assurance Manager jobs in Boston, MA

Quality Assurance Engineer jobs in Boston, MA

Senior Quality Assurance Engineer jobs in Boston, MA

Quality Assurance Analyst jobs in Quincy, MA

Senior Software Engineer jobs in Mansfield, MA

Software Quality Assurance Engineer jobs in Boston, MA

Quality Assurance Analyst jobs in West Deptford, Nj

Quality Assurance Remote jobs in Fort Worth, Tx

Food Quality Assurance jobs in Milwaukee, Wi

Quality Assurance Analyst jobs in Detroit, Mi

Trading Analyst jobs in New York, Ny

Quality Assurance Analyst jobs in Manchester, Nh

Civil Engineer jobs in Arizona

Software Tester jobs in Tampa, Fl

Software Test Engineer jobs in Modesto, Ca

Software Test Engineer jobs in Fremont, Ca

Software Engineer jobs in Iowa

Specialist, QA Test Automation

Breezeline -
Quincy, MA

Apply Now

Job Details

Full-time
$77 an hour
7 days ago

Qualifications

AI tools proficiency
APIs
Developing automated testing protocols
Quality check automation

Full Job Description

Our culture lifts you up—there is no ego in the way. Our common purpose? We all want to win for our customers. We aim to always be evolving, dynamic, and ambitious. We believe in the power of genuine connections. Each employee is a part of what makes us unique on the market: agile and dedicated.

Time Type:

Regular

Job Description :

Specialist, QA Test Automation

POSITION SUMMARY

We aren't looking for an all-knowing AI guru to define our entire organizational strategy from scratch. We are looking for a sharp, curious Specialist, QA Test Automation who can bridge the gap between strategic vision and day-to-day technical execution. Working closely with the Chapter Lead, QA — who provides the overarching AI QA strategy—you will be embedded within Cogeco’s AI squads to bring that strategy to life.

In this role, you will move past standard "pass/fail" scripts to tackle the complex world of non-deterministic outputs. You will focus heavily on probabilistic testing, curating golden datasets, and leveraging cutting-edge LLM evaluation tools like Promptfoo. If you have a solid foundation in QA or software engineering, a healthy obsession with automation, and a restless drive to learn, you’ll fit right in.

KEY RESPONSIBILITIES

Probabilistic Testing & Evaluation

Embrace the Unpredictable: Implement and refine testing workflows tailored for AI powered solutions where outputs are probabilistic rather than deterministic.
Regression & Drift Detection: Build guardrails to identify model drift, prompt regression, hallucination risks, and safety violations before they hit production.

Dataset Curation & Tooling

Golden Datasets: Own the creation, maintenance, and scaling of high-quality golden datasets used as the source of truth for benchmarking model changes.
AI Eval Tooling: Champion programmatic evaluation tools such as Promptfoo, DeepEval, or Ragas to automate the assessment of prompt variants and model performance.

Strategy Execution & Collaboration

Chapter Alignment: Partner closely with the Chapter Lead, QA to translate high-level AI QA frameworks into actionable, daily tasks for technical teams.
Feedback Loop: Provide real-time feedback to the Chapter Lead on how the strategy is performing in the trenches, recommending practical pivots based on real-world results.

Automation & CI/CD Integration

Smart Pipelines: Collaborate with DevOps specialists to inject AI evaluation metrics directly into modern CI/CD pipelines, ensuring automated gates handle fluid AI responses.
Data Validation: Validate data pipelines feeding our models, ensuring that data integrity is maintained from ingestion to inference.

ESSENTIAL QUALIFICATIONS

Academic Training & Mindset

College diploma or Degree in Computer Science, Engineering, or a related discipline (or equivalent practical experience).
The Right Mindset: A strong foundation in core QA principles combined with a passion for AI/ML. You don't need a PhD; you just need to be eager to learn how LLMs behave.

Work Experience & Technical Skills

3+ years of experience in Quality Assurance, Software Engineering, or Data Engineering.
Hands-on Scripting: Experience in Python or JavaScript/TypeScript (essential for configuring evaluation frameworks like Promptfoo and manipulating test data).
Modern QA Ecosystem: Experience with test automation frameworks, API testing, and code repositories (Git).

STRONG ASSETS

Exposure to Golden Datasets: creating, maintenance, and/or scaling of high-quality golden datasets used as the source of truth for benchmarking model changes.
Expsosure to AI Eval Tooling: Champion programmatic evaluation tools such as Promptfoo, DeepEval, or Ragas to automate the assessment of prompt variants and model performance.
CI/CD Familiarity: Experience working with pipeline tools (e.g., Bitbucket pipelines, Google Cloud run, GitHub Actions, GitLab CI, Jenkins).

SPECIFIC COMPETENCIES

Technical Execution & Curiosity

Analytical Deep-Dives: Comfortable analyzing data inputs/outputs and debugging prompts to identify the root causes of unexpected AI behavior.
Tool Adaptability: Ready to quickly learn, test, and implement new open-source AI evaluation and observability tooling as the ecosystem evolves.

Growth Mindset & Adaptability

Comfortable with Ambiguity: Thrives in a high-uncertainty environment where standard QA blueprints don’t always apply.
Execution Focus: Excel at taking an established roadmap or framework and running with it, troubleshooting technical blockers independently.

Collaboration & Communication

Squad Partner: Able to communicate technical testing gaps clearly to both AI developers and product owners.
Open to constructive criticism: Open to constructive feedback, willing to experiment, and values an environment where mistakes are treated as learning milestones.

You’ll benefit from:

Flexibility: Yes, we think that what you do matters. At work and at home.
Fun: We laugh a lot, it makes every day brighter.
Discounted services: We provide amazing services to our clients, and you’ll get them at home, because you deserve them.
Rewarding Pay: Let's be honest, everybody likes to make a good salary. We offer attractive compensation packages, and it comes with a great culture.
Benefits: We’ve got you covered.
Career Evolution: Join us and we will give you the tools to achieve your career goals!
Technology: You have a passion for technology? Excellent, we do too. Here, you will manage, influence, play, create, fix, and shape the industry.

For candidates whose primary place of work will be in Massachusetts, the expected salary range for this position is $85 600 – $128 400. For candidates whose primary place of work will be in Cleveland, OH, the expected salary range is $77 800 – $116 800.

This range represents the annual salary or hourly wage that Breezeline expects to pay for this position at the time of this posting. Individual pay is determined by various factors, including but not limited to job-related skills, relevant experience, education, and specific work location.

#LI-KN1

#LI-Hybrid

Location :

Quincy, MA

Company :

Breezeline

At Cogeco, we know that different backgrounds, perspectives, and beliefs can bring critical value to our business. The strength of this diversity enhances our ability to imagine, innovate, and grow as a company. So, we are committed to doing everything in our power to create a more diverse and inclusive world of belonging.

By creating a culture where all our colleagues can bring their best selves to work, we’re doing our part to build a more equitable workplace and world. From professional development to personal safety, Cogeco constantly strives to create an environment that welcomes and nurtures all. We make the health and well-being of our colleagues one of our highest priorities, for we know engaged and appreciated employees equate to a better overall experience for our customers.

If you need any accommodations to apply or as part of the recruitment process, please contact us confidentially at [email protected]

Apply Now

Refine Your Search

software qa automation jobs in quincy ma

I want to receive the latest job alert for software qa automation in quincy ma

Related Searches

Explore jobs in more locations

Time Type:

Job Description :

Specialist, QA Test Automation

KEY RESPONSIBILITIES

Probabilistic Testing & Evaluation

Dataset Curation & Tooling

Strategy Execution & Collaboration

Automation & CI/CD Integration

ESSENTIAL QUALIFICATIONS

Academic Training & Mindset

Work Experience & Technical Skills

STRONG ASSETS

SPECIFIC COMPETENCIES

Technical Execution & Curiosity

Growth Mindset & Adaptability

Collaboration & Communication

Location :

Company :