Skip to main content
POST
/
v1
/
evaluators
Create an evaluator
curl --request POST \
  --url https://api-sandbox.featherhq.com/v1/evaluators \
  --header 'Content-Type: application/json' \
  --header 'x-api-key: <api-key>' \
  --data '
{
  "name": "<string>",
  "description": "<string>",
  "owner": "<string>",
  "status": "active",
  "config": {},
  "prompt": "<string>",
  "threshold": 123,
  "severity": "medium",
  "judge_model_override": "<string>",
  "kind": "model_judge",
  "format": "score",
  "tags": [
    "<string>"
  ]
}
'
{
  "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "organization_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "name": "<string>",
  "kind": "<string>",
  "format": "<string>",
  "description": "<string>",
  "owner": "<string>",
  "status": "<string>",
  "prompt": "<string>",
  "threshold": 123,
  "severity": "<string>",
  "judge_model_override": "<string>",
  "created_at": "2023-11-07T05:31:56Z",
  "updated_at": "2023-11-07T05:31:56Z",
  "config": {},
  "tags": [
    "<string>"
  ],
  "created_by": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
}

Authorizations

x-api-key
string
header
required

Body

application/json
name
string
required
Maximum string length: 200
description
string | null
Maximum string length: 4096
owner
string | null
Maximum string length: 200
status
enum<string>
default:active
Available options:
active,
inactive,
archived
config
Config · object
prompt
string | null
Maximum string length: 16384
threshold
number | null
severity
enum<string>
default:medium
Available options:
info,
low,
medium,
high,
critical
judge_model_override
string | null
Maximum string length: 200
kind
enum<string>
default:model_judge
Available options:
model_judge,
deterministic
format
enum<string>
default:score
Available options:
boolean,
enum,
numeric,
score
tags
string[]
Maximum array length: 64

Response

Successful Response

id
string<uuid>
required
organization_id
string<uuid>
required
name
string
required
kind
string
required
format
string
required
description
string | null
required
owner
string | null
required
status
string
required
prompt
string | null
required
threshold
number | null
required
severity
string
required
judge_model_override
string | null
required
created_at
string<date-time>
required
updated_at
string<date-time>
required
config
Config · object
tags
string[]
created_by
string<uuid> | null