Create an evaluation set
POST
/v1/evaluationsHow to call this endpoint
Every ACP API request uses bearer authentication. The examples here show the actual request path, auth header, and body shape that the platform expects.
Path, query, and header parameters
These parameters control which ACP object the endpoint acts on and how the request is processed.
Path parameters
None.
Query parameters
None.
Body schema
Content type: application/json · Required
| Field | Type | Required | Description |
|---|---|---|---|
| name | string | Yes | Human-readable name. |
| description | string | No | Human-readable description. |
| cases | object[] | No | — |
| cases[].id | string | No | Unique identifier. |
| cases[].name | string | No | Human-readable name. |
| cases[].input | string | Yes | — |
| cases[].expectedOutput | string | No | — |
| cases[].expected_output | string | No | — |
| cases[].evaluationGuidance | string | No | — |
| cases[].evaluation_guidance | string | No | — |
| cases[].rubric | string | No | — |
| cases[].weight | number | No | — |
| cases[].optimizationRole | train | validation | holdout | No | — |
| cases[].optimization_role | train | validation | holdout | No | — |
| cases[].metadata | object | No | Free-form metadata object. |
| metadata | object | No | Free-form metadata object. |
What the API returns
Each response code below includes the documented payload shape for the ACP API.
201Created evaluation setapplication/json
| Field | Type | Required | Description |
|---|---|---|---|
| evaluation | object | Yes | — |
| evaluation.id | string | Yes | Unique identifier. |
| evaluation.name | string | Yes | Human-readable name. |
| evaluation.description | string | Yes | Human-readable description. |
| evaluation.cases | object[] | Yes | — |
| evaluation.cases[].id | string | Yes | Unique identifier. |
| evaluation.cases[].name | string | Yes | Human-readable name. |
| evaluation.cases[].input | string | Yes | — |
| evaluation.cases[].expectedOutput | string | Yes | — |
| evaluation.cases[].evaluationGuidance | string | Yes | — |
| evaluation.cases[].weight | number | Yes | — |
| evaluation.cases[].optimizationRole | train | validation | holdout | Yes | — |
| evaluation.cases[].metadata | object | Yes | Free-form metadata object. |
| evaluation.publishedVersionId | string | Yes | — |
| evaluation.metadata | object | Yes | Free-form metadata object. |
| evaluation.createdAt | string | Yes | ISO 8601 timestamp. |
| evaluation.updatedAt | string | Yes | ISO 8601 timestamp. |