Skip to main content

Get Eval Dataset Executions

GET 
/api/v1/pipelines/:pipeline_id/eval-datasets/:eval_dataset_id/execute

Get the status of an EvalDatasetExecution.

Request​

Path Parameters

    pipeline_id uuidrequired
    eval_dataset_id uuidrequired

Cookie Parameters

    session any

Responses​

Successful Response

Schema

  • Array [

    • job_name Job Name (string)required

    Possible values: [eval_dataset_job]

    partitions

    object

    required

    The partitions for this execution. Used for determining where to save job output.

    anyOf

    parameters

    object

    Additional input parameters for the eval execution.

    anyOf

    eval_question_ids uuid[]required

    The IDs for the EvalQuestions this execution ran against.

    eval_execution_params

    object

    required

    Schema for the params for an eval execution.

    llm_model SupportedLLMModelNames (string)

    Possible values: [GPT_3_5_TURBO, GPT_4, GPT_4_TURBO, GPT_4O, GPT_4O_MINI, AZURE_OPENAI]

    Default value: GPT_4O

    The LLM model to use within eval execution.

    qa_prompt_tmpl Qa Prompt Tmpl (string)

    Default value: `Context information is below.

    {context_str}

    Given the context information and not prior knowledge, answer the query. Query: {query_str} Answer: `

    The template to use for the question answering prompt.

    session_id

    object

    The upstream request ID that created this job. Used for tracking the job across services.

    anyOf

    string

    correlation_id

    object

    The correlation ID for this job. Used for tracking the job across services.

    anyOf

    string

    parent_job_execution_id

    object

    The ID of the parent job execution.

    anyOf

    string

    user_id

    object

    The ID of the user that created this job

    anyOf

    string

    created_at date-time

    Creation datetime

    id uuid

    Unique identifier

    status StatusEnum (string)required

    Possible values: [PENDING, SUCCESS, ERROR, PARTIAL_SUCCESS]

    Enum for representing the status of a job

    error_code

    object

    anyOf

    string

    error_message

    object

    anyOf

    string

    attempts

    object

    The number of times this job has been attempted

    anyOf

    integer

    started_at

    object

    anyOf

    string

    ended_at

    object

    anyOf

    string

    updated_at date-time

    Update datetime

    data

    object

    Additional metadata for the job execution.

    anyOf

  • ]

Loading...