Skip to main content

Alexa Griffith

Jul 6, 2026

3:08
people that aren't very technical, explain to them what a gateway is for an AI system.
3:14
Yeah, so, I mean, the name Gateway is a good name for it as well.
3:19
What we were doing with the Envoy Gateway and the problem that we were solving is that when Gen AI came into play and our AI engineers wanted to build products on LLMs to get more resources and to get experimentation going and building those products, we need to have access to them, so that means that we were using different model providers, so GCP, Azure, AWS, but all of this traffic is going outside of Bloomberg's system, and that needs to be secure, we need to manage it, and we need to be able to have observability, know everything that's going on, and as a platform team, ideally it needs to be easy to use.
3:56
And if you use all of these different providers just as they are, none of those things are true.
4:01
So what you need is a gateway in front of it.
4:03
So we run this instance and all the traffic passes in and out from us so we can control it.
4:09
We have like a unified API, for example.

30 MINS LATER

33:50
Have you been involved in any of that, and does it worry you?

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.