Explain retained native and imported evidence in one check report
GET
/v1/quality/checks/{kind}/{resourceId}/reportRead-only repeatable database view over native runs, retained observations, measurements and diagnostic comparisons. Each percentage retains its own cohort and receipt. History is bounded to ten entries; existing collection APIs provide full history. Imported provenance and missing measurements remain explicit. Does not execute, regrade or approve a target.
How to call this endpoint
Every ACP API request uses bearer authentication. The examples here show the actual request path, auth header, and body shape that the platform expects.
Path, query, and header parameters
These parameters control which ACP object the endpoint acts on and how the request is processed.
Path parameters
| Name | Location | Type | Required | Description |
|---|---|---|---|---|
| kind | path | assertion | benchmark | Yes | — |
| resourceId | path | string | Yes | — |
Query parameters
None.
Body schema
This endpoint does not require a request body.
None.
What the API returns
Each response code below includes the documented payload shape for the ACP API.
200Scoped evidence report, independent of the number of native Evaluation runsapplication/json
| Field | Type | Required | Description |
|---|---|---|---|
| report | object | Yes | — |
| report.schemaVersion | computer_agents_quality_report_v1 | Yes | — |
| report.subject | object | Yes | — |
| report.subject.kind | check | Yes | — |
| report.subject.checkKind | assertion | benchmark | Yes | — |
| report.subject.id | string | Yes | Unique identifier. |
| report.subject.name | string | Yes | Human-readable name. |
| report.generatedAt | string | Yes | — |
| report.evidenceAsOf | string | Yes | — |
| report.evidenceState | empty | unmeasured | partial | ready | invalid | Yes | Evidence presentation state, never activation or production readiness. |
| report.checks | object[] | Yes | — |
| report.checks[].check | object | Yes | — |
| report.checks[].check.id | string | Yes | Kind-namespaced identity; never use as a native resource ID |
| report.checks[].check.kind | assertion | benchmark | Yes | — |
| report.checks[].check.resourceId | string | Yes | Preserved native Test or Evaluation identity |
| report.checks[].check.name | string | Yes | Human-readable name. |
| report.checks[].check.description | string | Yes | Human-readable description. |
| report.checks[].check.status | string | Yes | Current lifecycle status. |
| report.checks[].check.publishedVersionId | string | Yes | — |
| report.checks[].check.caseCount | integer | Yes | — |
| report.checks[].check.creatorUserId | string | Yes | Stable user identity of the resource creator |
| report.checks[].check.creatorName | string | Yes | Current display name resolved through the deployment identity directory |
| report.checks[].check.creatorAvatarUrl | string | Yes | Current creator profile image URL |
| report.checks[].check.createdAt | string | Yes | ISO 8601 timestamp. |
| report.checks[].check.updatedAt | string | Yes | ISO 8601 timestamp. |
| report.checks[].inventory | object | Yes | — |
| report.checks[].inventory.nativeRuns | integer | Yes | — |
| report.checks[].inventory.observationBatches | integer | Yes | — |
| report.checks[].inventory.measurements | integer | Yes | — |
| report.checks[].inventory.experiments | integer | Yes | — |
| report.checks[].inventory.comparisons | integer | Yes | — |
| report.checks[].inventory.unmeasuredObservationBatches | integer | Yes | — |
| report.checks[].evidenceState | empty | unmeasured | partial | ready | invalid | Yes | Evidence presentation state, never activation or production readiness. |
| report.checks[].selected | null | Yes | — |
| report.checks[].metrics | object[] | Yes | — |
| report.checks[].metrics[].id | string | Yes | Unique identifier. |
| report.checks[].metrics[].label | string | Yes | — |
| report.checks[].metrics[].description | string | Yes | Human-readable description. |
| report.checks[].metrics[].numeratorLabel | string | Yes | — |
| report.checks[].metrics[].denominatorLabel | string | Yes | — |
| report.checks[].metrics[].unit | percent | Yes | — |
| report.checks[].metrics[].aggregation | micro | Yes | — |
| report.checks[].metrics[].direction | higher_is_better | lower_is_better | informational | Yes | — |
| report.checks[].metrics[].state | measured | partial | unmeasured | invalid | Yes | — |
| report.checks[].metrics[].value | number | Yes | — |
| report.checks[].metrics[].numerator | integer | Yes | — |
| report.checks[].metrics[].denominator | integer | Yes | — |
| report.checks[].metrics[].populationCount | integer | Yes | — |
| report.checks[].metrics[].includedCount | integer | Yes | — |
| report.checks[].metrics[].excludedCounts | object | Yes | — |
| report.checks[].metrics[].excludedCounts.unmeasured | integer | No | — |
| report.checks[].metrics[].excludedCounts.missing_reference | integer | No | — |
| report.checks[].metrics[].excludedCounts.source_changed | integer | No | — |
| report.checks[].metrics[].excludedCounts.not_applicable | integer | No | — |
| report.checks[].metrics[].excludedCounts.error | integer | No | — |
| report.checks[].metrics[].excludedCounts.skipped | integer | No | — |
| report.checks[].metrics[].excludedCounts.missing_output | integer | No | — |
| report.checks[].metrics[].excludedCounts.invalid | integer | No | — |
| report.checks[].metrics[].uncertainty | object | Yes | — |
| report.checks[].metrics[].uncertainty.kind | not_estimated | Yes | — |
| report.checks[].metrics[].uncertainty.reason | string | Yes | — |
| report.checks[].metrics[].evidence | object | Yes | — |
| report.checks[].metrics[].evidence.kind | measurement | native_run | observation | experiment | Yes | — |
| report.checks[].metrics[].evidence.checkKind | assertion | benchmark | Yes | — |
| report.checks[].metrics[].evidence.checkId | string | Yes | — |
| report.checks[].metrics[].evidence.id | string | Yes | Unique identifier. |
| report.checks[].metrics[].evidence.observationRunId | string | Yes | — |
| report.checks[].latestObservation | object | Yes | — |
| report.checks[].latestObservation.id | string | Yes | Unique identifier. |
| report.checks[].latestObservation.label | string | Yes | — |
| report.checks[].latestObservation.createdAt | string | Yes | ISO 8601 timestamp. |
| report.checks[].latestObservation.measured | boolean | Yes | — |
| report.checks[].latestNativeRun | object | Yes | — |
| report.checks[].latestNativeRun.id | string | Yes | Unique identifier. |
| report.checks[].latestNativeRun.status | string | Yes | Current lifecycle status. |
| report.checks[].latestNativeRun.createdAt | string | Yes | ISO 8601 timestamp. |
| report.checks[].comparisons | object[] | Yes | — |
| report.checks[].comparisons[].experiment | object | Yes | — |
| report.checks[].comparisons[].experiment.schemaVersion | computer_agents_quality_experiment_v1 | Yes | — |
| report.checks[].comparisons[].experiment.id | string | Yes | Unique identifier. |
| report.checks[].comparisons[].experiment.name | string | Yes | Human-readable name. |
| report.checks[].comparisons[].experiment.hypothesis | string | Yes | — |
| report.checks[].comparisons[].experiment.allowedChanges | string | Yes | — |
| report.checks[].comparisons[].experiment.baselineMeasurementId | string | Yes | — |
| report.checks[].comparisons[].experiment.candidateObservationRunId | string | Yes | — |
| report.checks[].comparisons[].experiment.primaryMetricId | string | Yes | — |
| report.checks[].comparisons[].experiment.minimumImprovementPercentagePoints | number | Yes | — |
| report.checks[].comparisons[].experiment.minimumPairedExamples | integer | Yes | — |
| report.checks[].comparisons[].experiment.guardrails | object[] | Yes | — |
| report.checks[].comparisons[].experiment.guardrails[].metricId | string | Yes | — |
| report.checks[].comparisons[].experiment.guardrails[].maximumRegressionPercentagePoints | number | Yes | — |
| report.checks[].comparisons[].experiment.evaluationId | string | Yes | — |
| report.checks[].comparisons[].experiment.versionId | string | Yes | — |
| report.checks[].comparisons[].experiment.purpose | diagnostic | Yes | — |
| report.checks[].comparisons[].experiment.design | retained_output_comparison | Yes | — |
| report.checks[].comparisons[].experiment.baselineMeasurementFingerprint | string | Yes | — |
| report.checks[].comparisons[].experiment.baselineObservationRunId | string | Yes | — |
| report.checks[].comparisons[].experiment.baselineObservationFingerprint | string | Yes | — |
| report.checks[].comparisons[].experiment.candidateObservationFingerprint | string | Yes | — |
| report.checks[].comparisons[].experiment.populationFingerprint | string | Yes | — |
| report.checks[].comparisons[].experiment.populationCount | integer | Yes | — |
| report.checks[].comparisons[].experiment.baselineSystemLabel | string | Yes | Caller-declared import label |
| report.checks[].comparisons[].experiment.candidateSystemLabel | string | Yes | Caller-declared import label |
| report.checks[].comparisons[].experiment.limits | object | Yes | — |
| report.checks[].comparisons[].experiment.limits.maximumComparisons | 1 | Yes | — |
| report.checks[].comparisons[].experiment.limits.maximumCases | 100 | Yes | — |
| report.checks[].comparisons[].experiment.limits.externalCalls | 0 | Yes | — |
| report.checks[].comparisons[].experiment.createdByUserId | string | Yes | — |
| report.checks[].comparisons[].experiment.createdAt | string | Yes | ISO 8601 timestamp. |
| report.checks[].comparisons[].experiment.fingerprint | string | Yes | — |
| report.checks[].comparisons[].comparison | null | Yes | — |
| report.checks[].comparisons[].baselineLabel | string | Yes | — |
| report.checks[].comparisons[].candidateLabel | string | Yes | — |
| report.checks[].history | object | Yes | — |
| report.checks[].history.data | object[] | Yes | — |
| report.checks[].history.data[].id | string | Yes | Unique identifier. |
| report.checks[].history.data[].kind | measurement | native_run | observation | experiment | Yes | — |
| report.checks[].history.data[].label | string | Yes | — |
| report.checks[].history.data[].createdAt | string | Yes | ISO 8601 timestamp. |
| report.checks[].history.data[].status | string | Yes | Current lifecycle status. |
| report.checks[].history.data[].versionId | string | Yes | — |
| report.checks[].history.data[].evidence | object | Yes | — |
| report.checks[].history.data[].evidence.kind | measurement | native_run | observation | experiment | Yes | — |
| report.checks[].history.data[].evidence.checkKind | assertion | benchmark | Yes | — |
| report.checks[].history.data[].evidence.checkId | string | Yes | — |
| report.checks[].history.data[].evidence.id | string | Yes | Unique identifier. |
| report.checks[].history.data[].evidence.observationRunId | string | Yes | — |
| report.checks[].history.hasMore | boolean | Yes | — |
| report.checks[].warnings | string[] | Yes | — |
| report.hasMoreChecks | boolean | Yes | — |
| report.warnings | string[] | Yes | — |
| report.activation | object | Yes | — |
| report.activation.allowed | false | Yes | — |
| report.activation.state | not_assessed | Yes | — |
| report.activation.reasons | string[] | Yes | — |
| report.fingerprint | string | Yes | Stable across refresh timestamps; binds the report and its selected evidence receipts. |
400Invalid identity or unsupported query
None.
401Authentication required
None.
403Organization or coarse permission unavailable
None.
404Check or evidence permission unavailable
None.
409Retained evidence integrity failed
None.
503Durable evidence or report capability unavailable; not an empty result
None.
Explain retained native and imported evidence in one check report
Loading...
Response 200
Loading...