LangSmith vs Portkey
LangSmith and Portkey are both building tools for AI teams. Compare pricing, hosting options, and product depth below.
LangSmith
https://smith.langchain.comLangSmith is a solution for bigger companies, and they’ve got the rooster to prove it. Because of the complexity, they’re not a good fit for smaller businesses and startups.
Read detailed reviewPro plan: $39/mo
Feature comparison
| Feature | LangSmith | Portkey |
|---|---|---|
| Self-hostable | Only for very large companies on 6-figure plans. | — |
| Prompt management | Yes | Yes |
| Prompt playground | Yes | Yes |
| LLM analytics | Yes | Yes |
| Feedback tracking | Yes | Yes |
| Agent tracing | Yes | No |
| Score conversations | Yes | — |
| Real-time evaluations | Yes | — |
| Exports | Yes | Yes |
| User tracking | No | Yes |
| PII masking | Requires custom code and complicated configuration. | — |
| Custom dashboards | Yes | — |
| Pro plan | $39/mo | $99/mo |
LangSmith
Pros
- Open-source
- Beautiful & modern UI
- Stable product
- Centered around chatbot usecases
- Stellar support for everyone
- Bootstrapped company
Cons
- Super confusing dashboard
- Requires a lot of configuration
- Complicated integration outside of LangChain
- Enterprise plans start at $75k
- No support for startups and individuals
Portkey
Powering the world's best AI teams.
From next-gen startups to established enterprises.
Building an AI chatbot?
Open-source GenAI monitoring, prompt management, and magic.
Open Source
Self Hostable
1-line Integration
Prompt Templates
Chat Replays
Analytics
Topic Classification
Agent Tracing
Custom Dashboards
Score LLM responses
PII Masking
Feedback Tracking
Open Source
Self Hostable
1-line Integration
Prompt Templates
Chat Replays
Analytics
Topic Classification
Agent Tracing
Custom Dashboards
Score LLM responses
PII Masking
Feedback Tracking

