Skip to main content
Torsten Köster

Torsten Köster

Senior Search & Observability Engineer specializing in Kubernetes, Apache Solr, and cloud infrastructure; freelance consultant based in Hamburg, Germany.

Jun 24, 2026

2:43
Tell me more about the operations for your AI.
2:50
Operations for AI applications is kind of fundamentally different than just regular applications.
2:58
Because with AI applications, tracing gets way more important to get...
3:06
And not only tracing, you just need a ton more of traces.
3:11
With classic applications, you might implement some tracing, like autotracing or whatnot, and you may sample your requests to get a good overview or a basic view of your deterministic operations in your application.
3:27
If you have an LLM doing the magic trick in your application, then you basically should trace 100% of your traces to get the full view because When using LLMs in applications, you open up your application to non-deterministic, to the entropy of the world, and it will do funny things.
3:52
I just had a talk and did a live demo, and it basically did funny things.

22 MINS LATER

26:08
Yeah, I mean, you have to distinguish

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.