StreamResponsePayload

StreamResponsePayload

JSON Example

{
    "choices": [
        {
            "delta": {
                "content": "you?",
                "role": "assistant"
            },
            "finish_reason": "stop",
            "index": 6
        }
    ],
    "created": 1700173217,
    "id": "3cdb958c-e4cc-4834-b52b-1d1a7f324714",
    "model": "llama-2-70b-chat-hf",
    "object": "chat.completion"
}

string

id

Optional

id

string

object

Optional

Constraints: default: chat.completion.chunk

object

integer

created

Required

created

string

model

Required

model

array of StreamChoice

choices

Required

choices