Skip to main content
POST
/
v1
/
datasets-v2
/
{datasetId}
/
evaluators
/
run
Run all evaluators attached to a dataset on every item
curl --request POST \
  --url https://api.lunary.ai/v1/datasets-v2/{datasetId}/evaluators/run \
  --header 'Authorization: Bearer <token>'
{
  "updatedItemCount": 123,
  "dataset": {
    "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "projectId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "ownerId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "ownerName": "<string>",
    "ownerEmail": "<string>",
    "name": "<string>",
    "description": "<string>",
    "createdAt": "2023-11-07T05:31:56Z",
    "updatedAt": "2023-11-07T05:31:56Z",
    "itemCount": 123,
    "currentVersionId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "currentVersionNumber": 123,
    "currentVersionCreatedAt": "2023-11-07T05:31:56Z",
    "currentVersionCreatedBy": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "currentVersionRestoredFromVersionId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot1Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot2Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot3Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot4Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot5Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "items": [
      {
        "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
        "datasetId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
        "input": "<string>",
        "groundTruth": "<string>",
        "output": "<string>",
        "evaluatorResult1": {},
        "evaluatorResult2": {},
        "evaluatorResult3": {},
        "evaluatorResult4": {},
        "evaluatorResult5": {},
        "createdAt": "2023-11-07T05:31:56Z",
        "updatedAt": "2023-11-07T05:31:56Z"
      }
    ]
  }
}

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

​
datasetId
string<uuid>
required

Response

200 - application/json

Evaluator results updated

​
updatedItemCount
integer
​
dataset
object