Roadmap

Here’s a preview of the key features and improvements coming soon to Lunary.
Check out our recent updates on the changelog.
Got a feature request or found a bug? Contact us via live chat.

October 2024

Lower playground pricing(in progress)

Alerts v2

Create fully custom email and webhook alerts on views with match thresholds.

Separate user feedback and operator feedback

In the details of a run, it should be possible to see the difference between feedback from operators and feedback from end users.

Usecases:

  • Multiple user feedbacks
  • 1 Operator annotation

In LLM & Traces:

  • Add user feedback below run
  • Add operator annotation as right now (next to output)

In Threads

  • show operator annotation below assistant message
  • Show user feedback as a timeline item in chat

Untitled.png

IMG_0065.jpeg

Prompts: add custom tags to versions

By adding custom tag to prompt versions, we can enable use cases such as A/B testing different variations of a prompt and serving different versions of a prompt to different users.

Dynamic Datasets: Use Prompts into datasets

That will make it easier to run evaluations on Prompts directly. Tie Prompts and Evaluations together.

We will allow using prompts in Datasets that are always up to date with their latest version. We'll also add a button "Add to dataset" in the Prompt directory

LLamaIndex Python support

Our most requested integration, LLamaIndex, is being worked on.

Show latest changelog items on dashboard

That will help make it easier for users to keep up with the latest changes.

November 2024

Report custom evaluation results(in progress)

See the results of custom evaluations ran from SDKs in the dashboard.

Custom charts and dashboards

Support for LlamaIndex TS