The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

AI observability platform for production LLM and agent systems.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Better Prometheus alerts for Kubernetes - smart grouping, AI enrichment, and automatic remediation

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

SRE Agent - CNCF Sandbox Project

Easy token price estimates for 400+ LLMs. TokenOps.

0x.Tools: X-Ray vision for Linux systems

Kubediff: a tool for Kubernetes to show differences between running state and version controlled configuration.

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

Observe FastAPI app with three pillars of observability: Traces (Tempo), Metrics (Prometheus), Logs (Loki) on Grafana through OpenTelemetry.

Production-Ready MCP Server Framework • Build, deploy & scale secure AI agent infrastructure • Includes Auth, Observability, Debugger, Telemetry & Runtime • Run real-world MCPs powering AI Agents

LangSmith Client SDK Implementations

ML powered analytics engine for outlier detection and root cause analysis.

A robust streaming log template miner based on the Drain algorithm

Web-based log viewer UI. Explore logs data stored in several sources: ClickHouse, Kubernetes or Docker

Datadog Python APM Client