APIs, MCP servers and models to monitor LLM apps
4 tools in the catalog do this, by name.
BraintrustPlatformPlatform for evaluating, tracing and monitoring AI apps and agents
LangfusePlatformOpen-source tracing, evals and prompt management for LLM apps
LiteLLMPackageOpen-source LLM gateway and Python SDK for 100+ model providers
Vercel AI GatewayProviderGateway that routes model requests across providers with fallbacks