As the world’s number 1 job site*, our mission is to help people get jobs. We strive to cultivate an inclusive and accessible workplace where all people feel comfortable being themselves. We're looking to grow our teams with more people who share our enthusiasm for innovation and creating the best experience for job seekers.
(*Comscore, Total Visits, March 2025)
As a Software Engineer III on the AI Gateway & Guardrails team at Indeed, you will own and drive the development of platform services that connect Indeed's AI-powered products to large and small language models (LLM and SLM), and safeguards AI actions. You will work alongside experienced engineers developing features for two core services; 1) AI Gateway, Indeed’s unified entry point for multiple model providers with built-in best practices, and 2) AI Guardrails Platform, Indeed’s universal safety layer for language model powered products.
In this role, you’d remove technical barriers to entry for teams all across Indeed to experiment with generative AI. This work provides an opportunity to leverage cutting-edge technologies across multiple cloud providers, influence the product direction for a broad spectrum of client teams, and guide best practices for AI use. You will contribute to architectural decisions, drive service reliability through SLOs and operational readiness, and partner with product teams across Indeed to ensure the platform meets compliance and quality standards required for production AI deployment.
-
Design, implement, and maintain platform services that provide secure, scalable, and reliable access to LLM and SLM providers across multiple cloud environments.
-
Contribute to multi-provider access, failover, and rate-limiting capabilities across cloud platforms (Azure, AWS, and GCP).
-
Drive improvements to the AI Guardrails Platform, such as content moderation and Personally Identifiable Information (PII) redaction
-
Facilitate technical discussions and contribute architectural decisions at the service and system level.
-
Identify and implement reliability improvements through SLOs, observability tooling, alerting, and runbook development.
-
Collaborate with engineers, product managers, and governance partners across teams to deliver compliant, production-ready AI systems.
-
Share knowledge and provide technical guidance with teammates.
-
Requires a Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering, and a minimum of 5 years of related experience; or a Master’s degree with a minimum of 3 years of experience; or a PhD without experience
-
Experience building or operating large-scale distributed systems, ideally within platform or infrastructure environments
-
Proficiency with cloud infrastructure across major providers (AWS, GCP, or Azure), including deployment, monitoring, and operations
-
Experience with or interest in AI/ML systems, including LLM-based services, prompt engineering, or AI safety approaches
-
Familiarity with reliability engineering practices such as SLOs, error budgets, observability tools, and on-call readiness
-
Solid grounding in data structures, algorithms, and core computer science principles, with a track record of solving complex technical problems
-
Demonstrated ownership, accountability, and a proactive mindset, paired with curiosity and a drive to continuously learn
Tier 1 - United States of America 118,000 - 178,000 USD per year
Tier 2 - United States of America 131,000 - 197,000 USD per year
Tier 3 - United States of America 145,000 - 217,000 USD per year
Tier 4 - N/A
Tier 5 - United States of America 166,000 - 248,000 USD per year
We care about what you care about. We have a multitude of benefits to support Indeedians, as well as their pets, kids, and partners including medical, dental, vision, disability and life insurance. Indeedians are able to enroll in our company’s 401k plan, as well as an equity-based incentive program. Indeedians will also receive open paid time off, 11 paid holidays a year and up to 26 weeks of paid parental leave. For more information, select your country and learn more about our employee benefits, program, & perks at https://www.indeed.com/careers/benefits!
Indeed is deeply committed to building a workplace and global community where inclusion is not only valued, but prioritized. We’re proud to be an equal opportunity employer, seeking to create a welcoming and diverse environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, family status, marital status, sexual orientation, national origin, genetics, neuro-diversity, disability, age, or veteran status, or any other non-merit based or legally protected grounds.
Indeed provides reasonable accommodations to qualified individuals with disabilities in the employment application process. To request an accommodation, please visit https://www.indeed.com/careers/accommodations. If you are requesting accommodation for an interview, please reach out at least one week in advance of your interview.
For more information about our commitment to equal opportunity/affirmative action, please visit our Careers page (https://www.indeed.com/careers).
Inclusion and belonging are fundamental to our hiring practices and company culture, forming an integral part of our vision for a better world of work. At Indeed, we’re committed to the wellbeing of our employees and on a mission to make this the best place to work and thrive. We believe that fostering an inclusive environment where every employee feels respected and accepted benefits everyone, fueling innovation and creativity.
We value diverse experiences, including those who have had prior contact with the criminal legal system. We are committed to providing individuals with criminal records, including formerly incarcerated individuals, a fair chance at employment.
Those with military experience are encouraged to apply. Equivalent expertise demonstrated through a combination of work experience, training, military experience, or education is welcome.
Like other employers Indeed uses our own technologies to help us find and attract top talent from around the world. In addition to our site’s user and privacy policy found at https://www.indeed.com/legal, we also want to make you aware of our recruitment specific privacy policy found at https://www.indeed.com/legal/indeed-jobs.
Indeed does not pay placement fees for unsolicited resumes or referrals from non-candidates, including search firms, staffing agencies, professional recruiters, fee-based referral services, and recruiting agencies (each individually, an "Agency"), subject to local laws. An Agency seeking a placement fee must obtain advance written approval from Indeed's internal Talent Acquisition team and execute a fee agreement with Indeed for each job opening before making a referral or submitting a resume for that opening.
AI Notice
Indeed is committed to ensuring fairness and transparency throughout our hiring process. We use artificial intelligence (AI) tools to assist in the screening, assessment, and selection of applicants for this position by analyzing information provided in resumes and applications. Our use of AI does not replace human decision-making.
Unless otherwise notified, Indeed does not use AI constituting an AEDT or an ADMT as those tools are defined in applicable laws.
This position accepts applications on an ongoing basis, and there is no deadline to apply.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Reference ID: 46965
