Top 190 Senior design evaluation engineer Jobs in Cary Nc

Senior AI Engineer
EAPPS TECH LLC dba Magicforce —Raleigh, NC
- $60 - $70 an hour
- Remote
- System design
- Continuous improvement
- Mentoring
Quick Apply
3d
Estimator II
McGough Construction —Raleigh, NC
- AutoCAD
- Construction site
- Engineering
Senior Network Engineer
Divers Alert Network (DAN) —Durham, NC
- Up to $120,000 a year
- Full-time
- Hybrid work
- Computer science
- 7 years
- Computer Science
Senior Estimator
McGough Construction —Raleigh, NC
- Construction site
- Computer literacy
- Research
Senior MES Engineer
PA Solutions —Raleigh, NC
- 7 years
- Computer Science
- Engineering
Lead Machine Learning Engineer
Motion Recruitment —Raleigh, NC
- Contract
- Azure
- System design
- Master's degree
13d
Instrumentation and Controls Engineer
Vantage Consulting —Research Triangle Park, NC
- $130,000 - $160,000 a year
- Full-time
- 5 years
- System design
- Office
- Dental insurance
- 401(k)
Quick Apply
Project Manager - Water/Wastewater
RK&K —Raleigh, NC
- Mentoring
- Senior level
- Professional Engineer
- Paid parental leave
- Paid holidays
Quick Apply
Engineer 2, Sustaining, R&D
Teleflex —Morrisville, NC
- Microsoft Excel
- Engineering
- English
Senior Hogan Engineer (Remote)
First Citizens Bank —Raleigh, NC
- $117,409 - $130,000 a year
- Full-time
- Remote
- System design
- High school diploma or GED
- Bachelor's degree
Senior Design Evaluation Engineer
Analog Devices —Durham, NC
- Full-time
- Mid-level
- Master's degree
- C++
Entry Level Engineers/Scientists/Chemists/Technicians
ERG —Chapel Hill, NC
- $50,000 - $60,000 a year
- Online Application
- Bachelor of Science
- CDL
- Analysis skills
- Profit sharing
- Paid holidays
Quick Apply
Senior Software Engineer
Pearson —Durham, NC
- $90,000 - $135,000 a year
- Full-time
- Hybrid work
- Research
- AWS
- Mentoring
Cloud Senior Principal Engineer
University of North Carolina System —Raleigh, NC
- Full-time
- System design
- Office
- Master's degree
Senior Software Engineer
Optum —Raleigh, NC
- $91,700 - $163,700 a year
- Full-time
- Remote
- Azure
- Pass drug screening
- Master's degree
Principal Engineer, Design Development, R&D
Teleflex —Morrisville, NC
- Engineering
- 11+ years
- Travel
Senior Systems Engineer
Eaton —Raleigh, NC
- $94,000 - $138,000 a year
- Hybrid work
- Background check
- Master's degree
- Analysis skills
- Relocation assistance
- Retirement plan
Junior Engineers/Scientists/Technicians
ERG —Raleigh, NC
- $60,000 - $75,000 a year
- Online Application
- Bachelor of Science
- 3 years
- Analysis skills
- Profit sharing
- Paid holidays
Quick Apply
Solution Engineer
Avalara —Durham, NC
- $184,500 - $295,300 a year
- Remote
- Oracle
- Senior level
- 10 years
- Paid parental leave
- Disability insurance
Staff Engineer / Staff Designer, Innovation
BD —Durham, NC
- 7 years
- System design
- Office

I want to receive the latest job alert for senior design evaluation engineer in cary nc

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

senior design evaluation engineer jobs near cary nc

Senior AI Engineer

EAPPS TECH LLC dba Magicforce
Raleigh, NC

Quick Apply

Job Details

$60 - $70 an hour
3 days ago

Qualifications

AI models
Tooling
Improving system uptime or availability
Software implementation
System design
Prompt engineering
System design for system development
Collaboration with product development teams
Model deployment
Design engineering
Experimental design
APIs
Developing and maintaining backend systems
Engineering product development
System deployment
MLOps
Debugging
Cross-functional communication

Full Job Description

Job Title: Senior AI Engineer

Location: Remote

Duration: 12+ Months

Job Description:

We are looking for a Senior AI Engineer to design, build, and deploy high-quality AI-powered features with end-to-end ownership from prototyping to production, ensuring reliable, scalable, and impactful AI solutions.

Mandatory skills

Core AI Skills

Strong understanding of LLM capabilities and limitations
Experience with prompt engineering and structured output design
Hands-on experience with embeddings and vector search
Familiarity with RAG architectures and when to apply them
Experience designing agent-based architectures (AgentCore concepts)
Understanding of tool use, planning strategies, and memory mechanisms in LLM systems

Engineering Skills

4+ years of related work experience
Solid backend/system design fundamentals
Experience building and deploying production-grade systems
Ability to debug complex issues, including probabilistic outputs
Comfort working with APIs, pipelines, and data flows

Product Thinking

Ability to translate user needs into effective AI solutions
Strong intuition for balancing quality, latency, and cost
Focus on delivering measurable product impact

Collaboration

Communicates clearly across engineering and product teams
Contributes to team knowledge and shared practices.

Good to have skills

Evaluate agent performance across multi-step tasks (task success rate, error propagation)
Debug and optimize agent decision-making and tool selection behavior

Responsibilities: -

End-to-End AI Feature Ownership

Design and implement AI-powered features (LLM workflows, copilots, and agent-based systems with tool use and multi-step reasoning)
Own the Full Lifecycle: prototyping evaluation production deployment iteration
Ensure solutions are reliable, performant, and aligned with product needs

AI System Implementation

Build and optimize prompt pipelines for specific use cases
Build retrieval systems (embeddings, chunking, ranking)
Implement RAG-based workflows where needed
Iterate on outputs to improve quality, accuracy, and consistency
Design scalable and cost-efficient AI architectures for production workloads
Select and evaluate models (hosted vs open-source) based on use case constraints

Agent-Based Systems (AgentCore)

Design and build agentic workflows capable of multi-step reasoning and decision-making
Integrate agents with tools, APIs, and internal systems to perform real-world actions
Implement planning, execution, and reflection loops for complex tasks
Manage context, memory, and state across multi-step interactions
Balance deterministic workflows vs. agent autonomy for reliability and control

Experimentation & Evaluation

Run structured experiments to compare approaches (prompting, retrieval, models)
Define and track key metrics for AI performance (quality, latency, cost)
Debug and improve non-deterministic system behavior
Build and maintain evaluation datasets and benchmarks
Implement automated evaluation pipelines for continuous improvement

Collaboration & Contribution

Drive technical direction and influence AI adoption across teams
Partner with product managers and designers to scope AI features
Contribute to shared patterns and reusable components
Participate in code reviews and design discussions
Support and mentor mid-level engineers where needed

AI Reliability, Safety & Governance

Design guardrails to ensure safe and reliable AI behavior
Mitigate hallucinations, prompt injection, and model misuse
Ensure compliance with data privacy and enterprise requirements
Implement monitoring and observability for AI systems in production
Implement guardrails for agent actions (tool access control, execution boundaries)
Prevent failure cascades in multi-step agent

Quick Apply

Refine Your Search

senior design evaluation engineer jobs in cary nc

Senior AI Engineer

Estimator II

Senior Network Engineer

Senior Estimator

Senior MES Engineer

Lead Machine Learning Engineer

Instrumentation and Controls Engineer

Project Manager - Water/Wastewater

Engineer 2, Sustaining, R&D

Senior Hogan Engineer (Remote)

Senior Design Evaluation Engineer

Entry Level Engineers/Scientists/Chemists/Technicians

Senior Software Engineer

Cloud Senior Principal Engineer

Senior Software Engineer

Principal Engineer, Design Development, R&D

Senior Systems Engineer

Junior Engineers/Scientists/Technicians

Solution Engineer

Staff Engineer / Staff Designer, Innovation

I want to receive the latest job alert for senior design evaluation engineer in cary nc

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected