Create Agent Completion

Create Agent Completion

Given a prompt, this method lets you retrieve one or more predicted completions along with the probabilities of alternative tokens at each position. The prompt is updated to reflect the agent settings and to use any inputs from enabled integrations, before it is forwarded to the LLM.

To leverage the newest models and features, you should consider using use the Chat Completions API instead.

This method is compatible with the OpenAI endpoint for creating a completion. However, it infers additional inputs to the prompt as described above.

Request
URI
POST
https://{api_host}/api/v1/compatibility/openai/v1/agents/{agent_id}/completions
COPY
Path Parameters
string
agent_id
Required

agent_id

Request Body
AgentCompletionsRequestPayload of type(s) application/json
Required

Show optional properties

{
    "prompt": "hello"
}
{
    "create_session": false,
    "seed": 0,
    "temperature": "number",
    "n": 0,
    "stop": [
        "string"
    ],
    "max_tokens": 0,
    "stream": false,
    "model": "string",
    "prompt": "string",
    "store_in_session": "string"
}
boolean
create_session
Optional

If true, the request creates a new agent session and the LLM interaction is stored as context for subsequent agent interactions when using the generated session.

integer
seed
Optional

Seed to propagate to the LLM for making repeated requests with the same seed as deterministic as possible. Note that this feature is in beta for most inference servers.

number
temperature
Optional
Constraints: minimum: 0 maximum: 2 default: 0

temperature

integer
n
Optional
Constraints: minimum: 1 default: 1

n

array of string
stop
Optional
Constraints: minItems: 1

stop

integer
max_tokens
Optional
Constraints: minimum: 1

max_tokens

boolean
stream
Optional

stream

string
model
Optional

Optional ID of the model to use. If provided, it must match the model specified in the agent configuration. Unless the client needs to validate that the specified model is in use by the agent, do not specify this value and the API will choose the correct model. For compatibility with the OpenAI client SDK, this parameter may either be unset or an empty string may be used to indicate the use of the agent default configuration.

string
prompt
Required

prompt

string As uuid As uuid
store_in_session
Optional

If set, use and extend the context stored in the given session for all LLM interactions.

Authentication
This operation uses the following authentication methods.
Responses
200

Successful Response

Operation doesn't return any data structure

400

Unexpected model in completions message

Operation doesn't return any data structure

404

No agent found with the specified ID or invalid Session ID

Operation doesn't return any data structure

422

Validation Error

Returns HTTPValidationError of type(s) application/json 
"HTTPValidationError Object"
array of object
detail
Optional

detail


Code Samples
COPY
                    curl -X POST -H 'Authorization: <value>' -H 'Content-Type: application/json' -d '{"prompt:"string"}' https://{api_host}/api/v1/compatibility/openai/v1/agents/{agent_id}/completions
On This Page
Agents Operations
GET
List Agents
POST
Create Agent
GET
List Assistants
POST
Create Assistant
GET
Get Agent
POST
Update Agent
DELETE
Delete Agent
GET
Get Assistant
POST
Update Assistant
DELETE
Delete Assistant
POST
Create Agent Chat Completion
POST
Create Assistant Chat Completion
POST
Create Agent Completion
POST
Create Assistant Completion