Senior LLMOps Engineer - Gateways
Kong (View all Jobs)
India-Bangalore
Interview Process
1. Phone interview. 2. Pairing and technical interviews. 3. Take home assigment.
Are you ready to power the World's connections?
About The Role
Kong’s API Management suite including the Kong Enterprise AI Gateway and Konnect support multiple AI capabilities for customers.
The AI Gateway offers a unified API for managing multiple Large Language Models (LLMs), allowing users to switch between different AI providers seamlessly. The AI Gateway also allows a variety of AI policies to be enforced such as semantic caching, advanced routing and load balancing, promt guards and Personally Identifiable Information (PII) sanitization. The Konnect SaaS platform exposes these same AI capabilities via Cloud Gateways and provides customers a variety of AI-driven insights into the operations of a customer’s API surface.
We are building out a new platform team - LLMOps - in our Bangalore office to help all the other engineering teams in Kong work with Large Language Models (LLMs) and build new features into our product portfolio.
About Kong
Kong Inc., a leading developer of cloud API technologies, is on a mission to enable companies around the world to become “API-first” and securely accelerate AI adoption. Kong helps organizations globally — from startups to Fortune 500 enterprises — unleash developer productivity, build securely, and accelerate time to market. For more information about Kong, please visit www.konghq.com or follow us on X @thekonginc.
#LI-KK1
Please mention No Whiteboard if you apply!
I'm a one-man team looking to improve tech interviews, and could use any support! 😄
Get weekly alerts of new jobs from companies not using whiteboard interviews!