Galileo
Evaluation, observability and guardrails for AI agents.
Evaluates and monitors agents and LLM apps with research-backed metrics and small evaluator models, and can turn those evaluators into runtime guardrails.
- Vendor
- Galileo
- Category
- Observability & evals
- Pricing
- Paid
- Open source
- No
- Platforms
- Cloud, Python, TypeScript
- Website
- galileo.ai
Features
- Agent evaluation
- Production monitoring
- Runtime guardrails
Best for
- Enterprise
- Agents
More observability & evals
- LangSmith — LangChain. Tracing, evals and monitoring for LLM apps.
- Langfuse — Langfuse. Open-source LLM engineering platform.
- MLflow — Databricks (Linux Foundation project). Open-source tracing, evaluation and prompt management for GenAI and ML.
- Braintrust — Braintrust. The evals platform for AI products.
- promptfoo — promptfoo. Test and red-team your LLM apps.
- Arize Phoenix — Arize AI. Open-source AI observability and evaluation.
- W&B Weave — Weights & Biases. Track and evaluate LLM applications.
- Helicone — Helicone. LLM observability via a one-line proxy.