AI Observability & Evaluation
AI observability platform for production LLM and agent systems.
Evaluation and Tracking for LLM Experiments and AI Agents
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
Fiddler Auditor is a tool to evaluate language models.
Small Language Model Inference, Fine-Tuning and Observability. No GPU, no labeled data needed.
A comprehensive solution for monitoring your AI models in production
A Python client to interact with Arize API
AI runtime inventory: discover shadow AI, trace LLM calls
Monitor, detect, and analyze security threats and Shadow AI in your LLM applications with comprehensive analytics and real-time alerting.
AxonFlow — Source-available AI control plane for production LLM systems
Observable AI cognition in Kotlin Multiplatform. Every agent decision emits a structured event — peer into the glass brain.
🎙️ Voice-native document intelligence using Gemini, ElevenLabs STT/TTS, and Datadog observability — turning text documents into spoken conversations.
Production operations framework for AI-powered SaaS. The architectural patterns, failure modes, and operational playbooks that determine whether your AI systems scale profitably or fail expensively.
AI agents write code, run commands, and delete files - autonomously. Polos gives them isolated sandboxes with built-in tools (shell, file system, web search), approval flows that reach you on various channels, and durable execution with automatic retries, prompt caching, and concurrency control. Agents get full power. Your systems stay safe.
AI Chat Watch (AICW) - free open-source tool for GEO marketers that track what & how AI mentions brands, products, companies.
Search for a holiday and get destination advice from an LLM. Observability by Dynatrace.
A report generator library for the ML models deployed on the Fiddler AI Observability platform
Add a description, image, and links to the ai-observability topic page so that developers can more easily learn about it.
To associate your repository with the ai-observability topic, visit your repo's landing page and select "manage topics."