Kong is internet hosting its API Summit 2024 occasion, and has made bulletins about a number of enhancements to its platforms. Key highlights are updates to Kong Konnect, its API administration platform, which additionally consists of new variations of Kong Insomnia, Kong Gateway, and Kong AI Gateway.
The newest updates to Kong Konnect assist corporations additional put together their API infrastructure to deal with AI use circumstances.
“There is no such thing as a AI with out APIs, and the most recent model of Kong Konnect delivers the important infrastructure for each. We intention to present companies the instruments to handle and scale their API site visitors securely, serving to drive innovation quicker than ever earlier than,” stated Augusto Marietti, CEO and co-founder of Kong Inc. “Kong Konnect offers a unified API platform for constructing, working and governing GenAI purposes.”
This replace consists of Konnect Service Catalog, which offers a single supply of reality for APIs and providers, which helps corporations handle shadow APIs by permitting them to do away with undiscovered or unused APIs. The Service Catalog additionally encompasses a Scorecard that assesses how compliance a service is with outlined standards.
Konnect Devoted Cloud Gateways are additionally now accessible on Azure and new AWS areas. In line with the corporate, this added availability permits organizations to deploy and handle their APIs throughout a number of clouds and preserve enterprise-grade SLAs.
Kong Insomnia 10, which is an API design and testing device, provides limitless assortment runs, AI Runner for growing GenAI apps, and Invite Management, which ensures that API property can solely be accessed by approved customers.
Different options on this launch of Kong Konnect embrace Serverless Gateways, a centralized and cloud-based repository for managing API configurations, and superior API and AI analytics.
The replace additionally introduces variations 3.8 of each Kong Gateway and Kong AI Gateway. Kong Gateway 3.8 provides Incremental Configuration Updates, which considerably reduces reminiscence and CPU utilization, and enhanced OpenTelemetry help.
Kong AI Gateway 3.8 provides a number of semantic reasoning capabilities, together with Semantic Caching, which acknowledges when completely different prompts characterize the identical query, leading to quicker response instances. As an example, “how lengthy does it take to cook dinner pasta?” and “how lengthy does it take to cook dinner spaghetti?” can be responded to with the identical cached response.
In line with the corporate, the flexibility to answer with cached responses cuts down on processing instances and reduces computational overhead.
One other new characteristic on this replace is Semantic Immediate Guard, which permits AI Gateway to know the “essence” of a request and block inappropriate prompts. Usually, these prompts are sorted out by figuring out particular key phrases, and this characteristic eliminates the necessity for that.
The three.8 launch additionally introduces Semantic Routing, which selects probably the most related LLM primarily based on a developer’s necessities.
“Kong AI Gateway 3.8 is a big step ahead in enabling organizations to completely harness the ability of AI,” stated Marco Palladino, co-founder and CTO of Kong. “By introducing Semantic Intelligence into our AI Gateway, we’re addressing probably the most urgent challenges confronted by enterprises leveraging GenAI as we speak — velocity, price and safety — whereas dramatically bettering the developer expertise.”
