Lenovo is building Quantum, a next‑generation hybrid AI platform spanning Windows, Android, and cloud. As part of this vision, we are expanding the engineering organization behind Qira, Lenovo’s cross‑device Personal AI that delivers intelligent, safe, and reliable experiences across Lenovo and Motorola products.
We are hiring an AI User Experience Reliability Lead to define and drive the technical strategy for reliability across Qira’s AI behaviors, outputs, and runtime safety systems. This role leads the engineering direction for how Qira’s intelligence is evaluated, monitored, and improved — ensuring users experience correct, consistent, stable, and trustworthy AI behavior at global scale.
This is a critical leadership position shaping one of the most important engineering domains within Qira and Lenovo’s broader AI strategy.
Location: Open to remote work in the US. The preferred work location is Chicago, IL.
AI Quality & Behavioral Reliability
Build and evolve evaluation frameworks, behavioral scorecards, and quality validation for models, prompts, retrievers, and task orchestration.
Develop systems to detect hallucinations, regressions, safety deviations, and other behavioral anomalies in real time.
Safety & Guardrail Reliability
Ensure the reliability of runtime safety systems, including content moderation, jailbreak/misuse detection, safety classifiers, and policy enforcement.
Partner with Safety, Legal, Ethics, and Product teams to convert requirements into robust technical safety solutions.
AI Observability & Telemetry
Define the telemetry, metrics, traces, and data needed to understand AI behavior end‑to‑end across device, edge, and cloud.
Reliability Engineering & Architecture Influence
Partner with engineering, AI/ML, and product teams to embed reliability into the design of prompts, models, policies, and workflow orchestration.
Cross‑Functional Leadership
Represent AI experience reliability in architectural reviews, product decisions, roadmap development, and launch readiness.
Collaborate with ML researchers, applied AI teams, data scientists, and UX to ensure user‑centric reliability goals.
Lead major engineering initiatives across AI quality, evaluation, safety assurance, and behavioral monitoring.
8+ years in AI/ML engineering, evaluation engineering, applied ML, reliability engineering, or large-scale distributed systems, with depth in AI behavior, evaluation, or safety.
Deep understanding of LLMs, model behavior, evaluation methods, retrieval‑augmented systems, or content moderation logic.
Experience with OpenTelemetry, Grafana, Prometheus, Loki, Tempo, or similar observability systems.
A passion for building AI systems that are correct, safe, reliable, and deeply aligned with user expectations.
Qira’s value is defined by its experience reliability — the confidence that users can trust its responses, its behavior, and its safety.
In this role, you will:
This is a rare opportunity to lead one of the most strategically important engineering functions in Lenovo’s AI roadmap.
The base salary budgeted range for this position is $190K - $210K. Individuals may also be considered for bonus and/or commission.
Lenovo’s various benefits can be found on www.lenovobenefits.com.
