LangSmith
Tracing, evals and monitoring for LLM apps.
Observability and evaluation platform for LLM applications and agents, framework-agnostic.
- Vendor
- LangChain
- Category
- Observability & evals
- Pricing
- Freemium
- Open source
- No
- Platforms
- Cloud, Self-hosted
- Launched
- 2023
- Website
- langchain.com/langsmith
Features
- Tracing
- Datasets & evals
- Prompt hub
Best for
- Enterprise
- Agents
More observability & evals
- Langfuse — Langfuse. Open-source LLM engineering platform.
- Braintrust — Braintrust. The evals platform for AI products.
- promptfoo — promptfoo. Test and red-team your LLM apps.
- Arize Phoenix — Arize AI. Open-source AI observability and evaluation.
- W&B Weave — Weights & Biases. Track and evaluate LLM applications.
- Helicone — Helicone. LLM observability via a one-line proxy.
- Ragas — Exploding Gradients. Evaluation metrics for RAG pipelines and agents.
- DeepEval — Confident AI. Pytest-style unit testing for LLM outputs.