Kong AI Gateway 3.8: Introducing Semantic Caching, Enhanced Security, New LLM Load-Balancing Algorithms, and Expanded Model Support by Kong Inc.

Introduction Kong has recently unveiled the latest iteration of its AI Gateway, version 3.8. This update brings several fresh features…

September 11, 2024