Roadmap
Here’s a preview of the key features and improvements coming soon to Lunary.
Check out our recent updates on the changelog.
Got a feature request or found a bug? Contact us via live chat.
July 2024
Dynamic Datasets: Import Prompts into datasets
That will make it easier to run evaluations on Prompts directly. Tie Prompts and Evaluations together.
We will allow using prompts in Datasets that are always up to date with their latest version. We'll also add a button "Add to dataset" in the Prompt directory
Add all Evaluation methods to JS SDK
We will bring the JS SDK to feature parity with the Python SDK.
Simplification of Evaluation SDK methods
We will deprecate the concept of Checklists, replaced by a new "Evaluators" concept. Assertions will now be done in the code instead of the dashboard, allowing for more flexibility of use-cases.
SMTP support for self-hosted deployments
We will add support for sending emails via SMTP for alerts, inviting users and all other email-related features.
Prompts: add custom tags to versions
By adding custom tag to prompt versions, we can enable use cases such as A/B testing different variations of a prompt and serving different versions of a prompt to different users.
Show latest changelog items on dashboard
That will help make it easier for users to keep up with the latest changes.
August 2024
Alerts v2
Create fully custom email and webhook alerts on views with match thresholds.
Upgrade to PostgreSQL 16
Support for LlamaIndex TS
LLamaIndex Python support
Our most requested integration, LLamaIndex, is being worked on.
Automatic instrumentation of OpenAI embeddings
Documentation for all API resources endpoints
We will publish the full documentation for the Logs, Analytics, Users, Prompts, Evaluations and Datasets endpoints.
