Opik
Open-source LLM tracing, evaluation and optimisation.
Logs traces of LLM apps and agents, runs LLM-as-judge and heuristic metrics, and includes prompt and agent optimisers; self-host or use Comet’s cloud.
- Vendor
- Comet
- Category
- Observability & evals
- Pricing
- Open source
- Open source
- Yes
- License
- Apache 2.0
- Platforms
- Python, TypeScript, Cloud, Self-host
- Launched
- 2024
- Website
- comet.com/site/products/opik
Features
- Tracing
- LLM-as-judge metrics
- Prompt optimiser
Best for
- Agents
- Enterprise
More observability & evals
- LangSmith — LangChain. Tracing, evals and monitoring for LLM apps.
- Langfuse — Langfuse. Open-source LLM engineering platform.
- Braintrust — Braintrust. The evals platform for AI products.
- promptfoo — promptfoo. Test and red-team your LLM apps.
- Arize Phoenix — Arize AI. Open-source AI observability and evaluation.
- W&B Weave — Weights & Biases. Track and evaluate LLM applications.
- Helicone — Helicone. LLM observability via a one-line proxy.
- Ragas — Exploding Gradients. Evaluation metrics for RAG pipelines and agents.