Kong to Support AGC in Strengthening Multi-LLM Governance and Cost Optimization
Kong Inc. announced that AGC Inc. has adopted its API management and AI Gateway services as a company-wide AI development platform. The implementation is designed for the secure and efficient use of multiple LLMs, including Azure OpenAI, Gemini, and Anthropic. It aims to balance governance and user adoption by visualizing costs and usage while establishing guardrails to prevent budget overruns.
📋 Article Processing Timeline
- 📰 Published: May 21, 2026 at 19:00
- 🔍 Collected: May 21, 2026 at 10:31
- 🤖 AI Analyzed: May 22, 2026 at 06:46 (20h 15m after Collected)
■ Background: Acceleration of Multi-LLM Utilization and Associated Challenges
As interest in AI grew within AGC, several challenges were identified. There was a rising demand from development teams to flexibly use various LLMs, such as Gemini and Anthropic, in addition to the mainly used Azure OpenAI. However, individual contracts for each business unit complicated processes and hindered rapid, company-wide AI adoption. Furthermore, it was difficult to accurately track API usage—who was using what and how much—making overall cost management and governance challenging. Anxiety about 'high bills from overuse' also acted as a psychological barrier for users, discouraging active AI experimentation.
■ Key Reasons for Selecting Kong: Balancing Governance and Speed
AGC selected Kong to address these challenges for the following main reasons:
- Centralized Management of Multi-LLM (AI Gateway): Kong acts as an intermediary, standardizing different LLM APIs, allowing developers to choose and switch between optimal AI models through a single interface with minimal switching costs.
- Consolidation of Contract and Approval Processes: By using Kong as a pre-vetted common platform, contract and governance management are centralized, streamlining processes for individual business units.
- Detailed Visualization of Usage and Costs: The platform enables tracking of usage per API consumer (department, project, or individual), facilitating future automation of internal chargebacks.
- Guardrails to Prevent Budget Overruns (AI Rate Limiting Advanced): The ability to set quotas and rate limits for each consumer automatically controls usage to prevent budget excesses, alleviating user concerns about unexpected high costs.
- Advanced Support for Agents/MCP: The platform's high extensibility supports AGC's vision of developing AI agents that access internal data and research papers.
The solution was procured through AWS Marketplace for its flexibility and alignment with existing cloud procurement processes.
■ Future Outlook
The project will begin with a rollout to developers and will be expanded in phases.
FAQ
Who are the companies involved in this partnership?
The main companies are Kong Inc., which provides the technology, and AGC Inc., the adopting company. Other mentioned technologies/platforms include Azure OpenAI, Gemini, Anthropic, and AWS Marketplace.
What problem did AGC face with AI adoption?
AGC faced challenges in managing multiple LLMs, inefficient procurement processes, a lack of visibility into usage and costs, and user hesitation due to fears of high, unpredictable expenses from pay-as-you-go models.
What solution did Kong provide to AGC?
Kong provided its API management and AI Gateway services to create a centralized platform that standardizes access to various LLMs, unifies contracting, visualizes usage and costs, and implements budget guardrails like quotas and rate limiting.
What are the key benefits of implementing Kong's solution for AGC?
The key benefits include unified management of multi-LLM environments, streamlined development processes, precise cost tracking for potential chargebacks, and elimination of user anxiety about excessive billing, thereby encouraging more active AI use.
How was Kong's solution procured and what is the future outlook?
The solution was procured via AWS Marketplace to align with existing cloud procurement processes. The rollout will begin with developers and gradually expand throughout the company, with an eye on future deployment to overseas locations.