Import an immutable dataset and create a published Evaluation
POST
/v1/evaluations/importsDecodes a CSV, JSON, JSONL, or NDJSON dataset, preserves physical duplicate columns, creates canonical Evaluation cases, stores the exact dataset and declared source-document bytes by SHA-256, rewrites mutable workspace/file references to immutable platform URIs, and atomically binds the sealed bundle to the published Evaluation version.
How to call this endpoint
Every ACP API request uses bearer authentication. The examples here show the actual request path, auth header, and body shape that the platform expects.
Path, query, and header parameters
These parameters control which ACP object the endpoint acts on and how the request is processed.
Path parameters
None.
Query parameters
None.
Body schema
Content type: application/json · Required
| Field | Type | Required | Description |
|---|---|---|---|
| name | string | Yes | Human-readable name. |
| description | string | No | Human-readable description. |
| filename | string | Yes | — |
| mimeType | string | No | — |
| contentType | string | No | — |
| data | string | Yes | Base64-encoded exact source dataset bytes. |
| mapping | object | No | — |
| mapping.id | string | No | Unique identifier. |
| mapping.name | string | No | Human-readable name. |
| mapping.input | string | No | — |
| mapping.expectedOutput | string | No | — |
| mapping.evaluationGuidance | string | No | — |
| mapping.optimizationRole | string | No | — |
| mapping.metadataColumns | string[] | No | — |
| mapping.defaultOptimizationRole | train | validation | holdout | No | — |
| caseLimit | integer | No | — |
| metadata | object | No | Free-form metadata object. |
| versionLabel | string | No | — |
| versionDescription | string | No | — |
| sourceAssets | object[] | No | Exact source-document bytes referenced by cases. Every mutable workspace:// or file:// URI must be declared and is rewritten to an immutable Evaluation source URI. |
| sourceAssets[].id | string | Yes | Unique identifier. |
| sourceAssets[].filename | string | Yes | — |
| sourceAssets[].mimeType | string | No | — |
| sourceAssets[].contentType | string | No | — |
| sourceAssets[].data | string | Yes | Base64-encoded exact source-document bytes. |
| sourceAssets[].originalUris | string[] | Yes | — |
| sourceAssets[].sha256 | string | No | Optional caller-computed digest. The import fails if it differs from the uploaded bytes. |
| sourceAssets[].metadata | object | No | Free-form metadata object. |
What the API returns
Each response code below includes the documented payload shape for the ACP API.
201Imported dataset and created Evaluationapplication/json
| Field | Type | Required | Description |
|---|---|---|---|
| evaluation | object | Yes | — |
| evaluation.id | string | Yes | Unique identifier. |
| evaluation.name | string | Yes | Human-readable name. |
| evaluation.description | string | Yes | Human-readable description. |
| evaluation.cases | object[] | Yes | — |
| evaluation.cases[].id | string | Yes | Unique identifier. |
| evaluation.cases[].name | string | Yes | Human-readable name. |
| evaluation.cases[].input | string | Yes | — |
| evaluation.cases[].expectedOutput | string | Yes | — |
| evaluation.cases[].evaluationGuidance | string | Yes | — |
| evaluation.cases[].weight | number | Yes | — |
| evaluation.cases[].optimizationRole | train | validation | holdout | Yes | — |
| evaluation.cases[].metadata | object | Yes | Free-form metadata object. |
| evaluation.publishedVersionId | string | Yes | — |
| evaluation.metadata | object | Yes | Free-form metadata object. |
| evaluation.createdAt | string | Yes | ISO 8601 timestamp. |
| evaluation.updatedAt | string | Yes | ISO 8601 timestamp. |
| version | object | Yes | — |
| version.id | string | Yes | Unique identifier. |
| version.version | integer | Yes | — |
| version.label | string | Yes | — |
| version.name | string | Yes | Human-readable name. |
| version.description | string | Yes | Human-readable description. |
| version.status | saved | published | archived | Yes | Current lifecycle status. |
| version.snapshot | object | Yes | — |
| version.snapshot.schemaVersion | computer_agents_evaluation_v1 | Yes | — |
| version.snapshot.name | string | Yes | Human-readable name. |
| version.snapshot.description | string | Yes | Human-readable description. |
| version.snapshot.cases | object[] | Yes | — |
| version.snapshot.cases[].id | string | Yes | Unique identifier. |
| version.snapshot.cases[].name | string | Yes | Human-readable name. |
| version.snapshot.cases[].input | string | Yes | — |
| version.snapshot.cases[].expectedOutput | string | Yes | — |
| version.snapshot.cases[].evaluationGuidance | string | Yes | — |
| version.snapshot.cases[].weight | number | Yes | — |
| version.snapshot.cases[].optimizationRole | train | validation | holdout | Yes | — |
| version.snapshot.cases[].metadata | object | Yes | Free-form metadata object. |
| version.snapshot.metadata | object | Yes | Free-form metadata object. |
| version.evaluationFingerprint | string | Yes | — |
| version.metadata | object | Yes | Free-form metadata object. |
| version.publishedAt | string | Yes | — |
| version.createdAt | string | Yes | ISO 8601 timestamp. |
| version.updatedAt | string | Yes | ISO 8601 timestamp. |
| datasetAsset | object | Yes | — |
| datasetAsset.id | string | Yes | Unique identifier. |
| datasetAsset.schemaVersion | computer_agents_evaluation_dataset_asset_v1 | computer_agents_evaluation_dataset_asset_v2 | Yes | — |
| datasetAsset.evaluationId | string | Yes | — |
| datasetAsset.evaluationVersionId | string | Yes | — |
| datasetAsset.filename | string | Yes | — |
| datasetAsset.contentType | string | Yes | — |
| datasetAsset.format | csv | json | jsonl | Yes | — |
| datasetAsset.sha256 | string | Yes | — |
| datasetAsset.bundleSha256 | string | Yes | — |
| datasetAsset.sizeBytes | integer | Yes | — |
| datasetAsset.sourceRowCount | integer | Yes | — |
| datasetAsset.importedCaseCount | integer | Yes | — |
| datasetAsset.sourceAssetCount | integer | Yes | — |
| datasetAsset.columns | object[] | Yes | — |
| datasetAsset.columns[].index | integer | Yes | — |
| datasetAsset.columns[].key | string | Yes | — |
| datasetAsset.columns[].sourceName | string | Yes | — |
| datasetAsset.mapping | object | Yes | — |
| datasetAsset.mapping.id | string | No | Unique identifier. |
| datasetAsset.mapping.name | string | No | Human-readable name. |
| datasetAsset.mapping.input | string | No | — |
| datasetAsset.mapping.expectedOutput | string | No | — |
| datasetAsset.mapping.evaluationGuidance | string | No | — |
| datasetAsset.mapping.optimizationRole | string | No | — |
| datasetAsset.mapping.metadataColumns | string[] | No | — |
| datasetAsset.mapping.defaultOptimizationRole | train | validation | holdout | No | — |
| datasetAsset.metadata | object | Yes | Free-form metadata object. |
| datasetAsset.createdAt | string | Yes | ISO 8601 timestamp. |
| sourceAssets | object[] | Yes | — |
| sourceAssets[].id | string | Yes | Unique identifier. |
| sourceAssets[].schemaVersion | computer_agents_evaluation_source_asset_v1 | Yes | — |
| sourceAssets[].datasetAssetId | string | Yes | — |
| sourceAssets[].evaluationId | string | Yes | — |
| sourceAssets[].evaluationVersionId | string | Yes | — |
| sourceAssets[].logicalId | string | Yes | — |
| sourceAssets[].filename | string | Yes | — |
| sourceAssets[].contentType | string | Yes | — |
| sourceAssets[].sha256 | string | Yes | — |
| sourceAssets[].sizeBytes | integer | Yes | — |
| sourceAssets[].originalUris | string[] | Yes | — |
| sourceAssets[].immutableUri | string | Yes | — |
| sourceAssets[].metadata | object | Yes | Free-form metadata object. |
| sourceAssets[].createdAt | string | Yes | ISO 8601 timestamp. |
400Invalid dataset
None.
413Dataset or source bundle exceeds its size limit
None.
Import an immutable dataset and create a published Evaluation
Loading...
Response 201
Loading...