LangFuse vs Portkey
LangFuse and Portkey are both great platforms for building AI apps.
We are building Lunary to be the best observability and monitoring tool for AI. We added it to the comparison below so you can get an idea of
how it compares.
LangFuse | Portkey | Lunary | |
Open SourceThe source code can be reviewed and people can contribute to it. | ✅ | ❌ | ✅ |
Self HostableThe platform can be hosted freely on your own servers, allowing to control costs and ensure your data privacy standards. | ✅ | ❌ | ✅ |
BootstrappedThe company cares more about customers than investors. | ❌ | ❌ | ✅ |
EvaluationsTest your prompts and agents. Ensure Improve your app's quality. | ✅ | ❌ | ✅ |
AlertsConfigure custom alerts to be notified when outlier runs or errors are detected. | ❌ | ❌ | ✅ |
Public APIAccess your data through a public API. | ✅ | ❌ | ✅ |
ExportsExport your data to CSV or JSONL. | ✅ | ❌ | ✅ |
Prompt PlaygroundExperiment and play with prompts in the dashboard. | ✅ | ✅ | ✅ |
Prompt TemplatesManage prompt templates with versioning. | ✅ | ✅ | ✅ |
Chat ReplaysReplay user conversations and see what feedback they leave. | ❌ | ❌ | ✅ |
Agent TracingDebug your agents with powerful nested tracing. | ✅ | ❌ | ✅ |
MetricsTrack your LLM usage with analytics. | ✅ | ✅ | ✅ |
Cost AnalyticsMonitor your costs segmented by agents, users and conversation. | ❌ | ✅ | ✅ |
RadarsIdentify misfit LLM prompts and responses, such as offensive language, negative sentiment, leakage of PII, and more. | ❌ | ❌ | ✅ |
No-code tests & evaluationsCreate tests & evaluations without writing any code. Just use the dashboard and see when your agents are misbehaving. | ❌ | ❌ | ✅ |
User TrackingTrack each user' usage and review their requests. | ❌ | ✅ | ✅ |
Feedback TrackingCollect feedback directly from your users. | ✅ | ✅ | ✅ |
LangChain SupportFirst-class support for LangChain. | ✅ | ✅ | ✅ |
LangChain Hybrid integrationFirst-class support for partially using LangChain (ex: building custom agents using langchain's Chat classes). | ❌ | ✅ | ✅ |
Are you building an AI product?
Lunary: open-source GenAI monitoring, prompt management, and magic.
Open Source
Self Hostable
Evaluations
Alerts
Public API
Exports
Prompt Templates
Chat Replays
Agent Tracing
Metrics
Feedback Tracking
LangChain Support
Open Source
Self Hostable
Evaluations
Alerts
Public API
Exports
Prompt Templates
Chat Replays
Agent Tracing
Metrics
Feedback Tracking
LangChain Support