Roadmap
Here’s a preview of the key features and improvements coming soon to Lunary.
Check out our recent updates on the changelog.
Got a feature request or found a bug? Contact us via live chat.
October 2024
Lower playground pricing(in progress)
Alerts v2
Create fully custom email and webhook alerts on views with match thresholds.
Separate user feedback and operator feedback
In the details of a run, it should be possible to see the difference between feedback from operators and feedback from end users.
Usecases:
- Multiple user feedbacks
- 1 Operator annotation
In LLM & Traces:
- Add user feedback below run
- Add operator annotation as right now (next to output)
In Threads
- show operator annotation below assistant message
- Show user feedback as a timeline item in chat
Prompts: add custom tags to versions
By adding custom tag to prompt versions, we can enable use cases such as A/B testing different variations of a prompt and serving different versions of a prompt to different users.
Dynamic Datasets: Use Prompts into datasets
That will make it easier to run evaluations on Prompts directly. Tie Prompts and Evaluations together.
We will allow using prompts in Datasets that are always up to date with their latest version. We'll also add a button "Add to dataset" in the Prompt directory
LLamaIndex Python support
Our most requested integration, LLamaIndex, is being worked on.
Show latest changelog items on dashboard
That will help make it easier for users to keep up with the latest changes.
November 2024
Custom charts and dashboards
Support for LlamaIndex TS
