name
: evaluation nameprompt
: the prompt you want to use for the evaluationtype
: evaluation type, currently only (“text” and “embeddings”) are supportedmodel
: model to use for evaluation (supported models: “gpt-4o”, “gpt-4o-mini”, “text-embedding-3-small”, “text-embedding-3-large”)is_sample
: run a sample instead of a whole datasettarget_column
: column to write the results totarget_branch
: branch to write the results toauto_commit
: automatically commit the results to the target branchcommit_message
: the commit message to use when auto_commit
ting:namespace
, :repo_name
, and :resource
with the appropriate values.
For example if the file you want to process is at:
https://oxen.ai/ox/customer-intents/main/data.parquet
The parameters should be:
:namespace
-> ox
:repo_name
-> customer-intents
:resource
-> main/data.parquet
(combination of branch name and file_name
)https://hub.oxen.ai/api/repos/ox/customer-intents/evaluations/main/data.parquet