Skip to content
For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL.
Primary navigation

Responses

Cancel a response
beta.responses.cancel(strresponse_id, ResponseCancelParams**kwargs) -> BetaResponse
POST/responses/{response_id}/cancel
Compact conversation
beta.responses.compact(ResponseCompactParams**kwargs) -> BetaCompactedResponse
POST/responses/compact
Connect
beta.responses.connect()
Function
Create a model response
beta.responses.create(ResponseCreateParams**kwargs) -> BetaResponse
POST/responses
Delete a model response
beta.responses.delete(strresponse_id, ResponseDeleteParams**kwargs)
DELETE/responses/{response_id}
Get a model response
beta.responses.retrieve(strresponse_id, ResponseRetrieveParams**kwargs) -> BetaResponse
GET/responses/{response_id}
ModelsExpand Collapse
class BetaApplyPatchTool:

Allows the assistant to create, delete, or update files using unified diffs.

class BetaCompactedResponse:

Flattened batched actions for computer_use. Each action includes an type discriminator and action-specific fields.

class BetaComputerTool:

A tool that controls a virtual computer. Learn more about the computer tool.

class BetaComputerUsePreviewTool:

A tool that controls a virtual computer. Learn more about the computer tool.

class BetaContainerAuto:
class BetaContainerNetworkPolicyAllowlist:
class BetaContainerNetworkPolicyDisabled:
class BetaContainerNetworkPolicyDomainSecret:
class BetaContainerReference:
class BetaCustomTool:

A custom tool that processes input using a specified format. Learn more about custom tools

class BetaEasyInputMessage:

A message input to the model with a role indicating instruction following hierarchy. Instructions given with the developer or system role take precedence over instructions given with the user role. Messages with the assistant role are presumed to have been generated by the model in previous interactions.

class BetaFileSearchTool:

A tool that searches for relevant content from uploaded files. Learn more about the file search tool.

class BetaFunctionShellTool:

A tool that allows the model to execute shell commands.

class BetaFunctionTool:

Defines a function in your own code the model can choose to call. Learn more about function calling.

Literal["low", "high", "auto", "original"]
class BetaInlineSkill:
class BetaInlineSkillSource:

Inline skill payload

class BetaLocalEnvironment:
class BetaLocalSkill:
class BetaNamespaceTool:

Groups function/custom tools under a shared namespace.

class BetaResponse:
class BetaResponseApplyPatchToolCall:

A tool call that applies file diffs by creating, deleting, or updating files.

class BetaResponseApplyPatchToolCallOutput:

The output emitted by an apply patch tool call.

class BetaResponseAudioDeltaEvent:

Emitted when there is a partial audio response.

class BetaResponseAudioDoneEvent:

Emitted when the audio response is complete.

class BetaResponseAudioTranscriptDeltaEvent:

Emitted when there is a partial transcript of audio.

class BetaResponseAudioTranscriptDoneEvent:

Emitted when the full audio transcript is completed.

class BetaResponseCodeInterpreterCallCodeDeltaEvent:

Emitted when a partial code snippet is streamed by the code interpreter.

class BetaResponseCodeInterpreterCallCodeDoneEvent:

Emitted when the code snippet is finalized by the code interpreter.

class BetaResponseCodeInterpreterCallCompletedEvent:

Emitted when the code interpreter call is completed.

class BetaResponseCodeInterpreterCallInProgressEvent:

Emitted when a code interpreter call is in progress.

class BetaResponseCodeInterpreterCallInterpretingEvent:

Emitted when the code interpreter is actively interpreting the code snippet.

class BetaResponseCodeInterpreterToolCall:

A tool call to run code.

class BetaResponseCompactionItem:

A compaction item generated by the v1/responses/compact API.

class BetaResponseCompactionItemParam:

A compaction item generated by the v1/responses/compact API.

class BetaResponseCompletedEvent:

Emitted when the model response is complete.

class BetaResponseComputerToolCall:

A tool call to a computer use tool. See the computer use guide for more information.

class BetaResponseComputerToolCallOutputItem:
class BetaResponseComputerToolCallOutputScreenshot:

A computer screenshot image used with the computer use tool.

class BetaResponseConfigurationUpdateItem:

A configuration update that applies to subsequent responses until it is replaced by another configuration update.

class BetaResponseConfigurationUpdateItemParam:

An update to the conversation’s response configuration. The configuration remains in effect for subsequent responses until it is replaced by another configuration update.

class BetaResponseContainerReference:

Represents a container created with /v1/containers.

Multi-modal input and output contents.

class BetaResponseContentPartAddedEvent:

Emitted when a new content part is added.

class BetaResponseContentPartDoneEvent:

Emitted when a content part is done.

class BetaResponseConversationParam:

The conversation that this response belongs to.

class BetaResponseCreatedEvent:

An event that is emitted when a response is created.

class BetaResponseCustomToolCall:

A call to a custom tool created by the model.

class BetaResponseCustomToolCallInputDeltaEvent:

Event representing a delta (partial update) to the input of a custom tool call.

class BetaResponseCustomToolCallInputDoneEvent:

Event indicating that input for a custom tool call is complete.

class BetaResponseCustomToolCallItem:

A call to a custom tool created by the model.

class BetaResponseCustomToolCallOutput:

The output of a custom tool call from your code, being sent back to the model.

class BetaResponseCustomToolCallOutputItem:

The output of a custom tool call from your code, being sent back to the model.

class BetaResponseError:

An error object returned when the model fails to generate a Response.

class BetaResponseErrorEvent:

Emitted when an error occurs.

class BetaResponseFailedEvent:

An event that is emitted when a response fails.

class BetaResponseFileSearchCallCompletedEvent:

Emitted when a file search call is completed (results found).

class BetaResponseFileSearchCallInProgressEvent:

Emitted when a file search call is initiated.

class BetaResponseFileSearchCallSearchingEvent:

Emitted when a file search is currently searching.

class BetaResponseFileSearchToolCall:

The results of a file search tool call. See the file search guide for more information.

An object specifying the format that the model must output.

Configuring { "type": "json_schema" } enables Structured Outputs, which ensures the model will match your supplied JSON schema. Learn more in the Structured Outputs guide.

The default format is { "type": "text" } with no additional options.

Not recommended for gpt-4o and newer models:

Setting to { "type": "json_object" } enables the older JSON mode, which ensures the message the model generates is valid JSON. Using json_schema is preferred for models that support it.

class BetaResponseFormatTextJSONSchemaConfig:

JSON Schema response format. Used to generate structured JSON responses. Learn more about Structured Outputs.

class BetaResponseFunctionCallArgumentsDeltaEvent:

Emitted when there is a partial function-call arguments delta.

class BetaResponseFunctionCallArgumentsDoneEvent:

Emitted when function-call arguments are finalized.

A piece of message content, such as text, an image, or a file.

An array of content outputs (text, image, file) for the function tool call.

class BetaResponseFunctionShellCallOutputContent:

Captured stdout and stderr for a portion of a shell tool call output.

class BetaResponseFunctionShellToolCall:

A tool call that executes one or more shell commands in a managed environment.

class BetaResponseFunctionShellToolCallOutput:

The output of a shell tool call that was emitted.

class BetaResponseFunctionToolCall:

A tool call to run a function. See the function calling guide for more information.

class BetaResponseFunctionToolCallItem:

A tool call to run a function. See the function calling guide for more information.

class BetaResponseFunctionToolCallOutputItem:
class BetaResponseImageGenCallCompletedEvent:

Emitted when an image generation tool call has completed and the final image is available.

class BetaResponseImageGenCallGeneratingEvent:

Emitted when an image generation tool call is actively generating an image (intermediate state).

class BetaResponseImageGenCallInProgressEvent:

Emitted when an image generation tool call is in progress.

class BetaResponseImageGenCallPartialImageEvent:

Emitted when a partial image is available during image generation streaming.

class BetaResponseInProgressEvent:

Emitted when the response is in progress.

Literal["file_search_call.results", "web_search_call.results", "web_search_call.action.sources", 5 more]

Specify additional output data to include in the model response. Currently supported values are:

  • web_search_call.results: Include the search results of the web search tool call.
  • web_search_call.action.sources: Include the sources of the web search tool call.
  • code_interpreter_call.outputs: Includes the outputs of python code execution in code interpreter tool call items.
  • computer_call_output.output.image_url: Include image urls from the computer call output.
  • file_search_call.results: Include the search results of the file search tool call.
  • message.input_image.image_url: Include image urls from the input message.
  • message.output_text.logprobs: Include logprobs with assistant messages.
  • reasoning.encrypted_content: Includes an encrypted version of reasoning tokens in reasoning item outputs. This enables reasoning items to be used in multi-turn conversations when using the Responses API statelessly (like when the store parameter is set to false, or when an organization is enrolled in the zero data retention program).
class BetaResponseIncompleteEvent:

An event that is emitted when a response finishes as incomplete.

Over WebSocket, steering can finish a response with response.incomplete_details.reason set to steered, followed automatically by a successor response.created that commits the queued steering input.

class BetaResponseInjectCreatedEvent:

Emitted when all injected input items were validated and committed to the active response.

class BetaResponseInjectEvent:

Injects input items into an active response over a WebSocket connection. The items are validated and committed atomically. Currently, the server accepts client-owned tool outputs that resume a waiting agent.

class BetaResponseInjectFailedEvent:

Emitted when injected input could not be committed to a response. The event returns the uncommitted raw input so the client can retry it in another response when appropriate.

A list of one or many input items to the model, containing different content types.

class BetaResponseInputAudio:

An audio input to the model.

class BetaResponseInputFile:

A file input to the model.

class BetaResponseInputFileContent:

A file input to the model.

class BetaResponseInputImage:

An image input to the model. Learn about image inputs.

class BetaResponseInputImageContent:

An image input to the model. Learn about image inputs

A message input to the model with a role indicating instruction following hierarchy. Instructions given with the developer or system role take precedence over instructions given with the user role. Messages with the assistant role are presumed to have been generated by the model in previous interactions.

A list of one or many input items to the model, containing different content types.

class BetaResponseInputMessageItem:
class BetaResponseInputText:

A text input to the model.

class BetaResponseInputTextContent:

A text input to the model.

Content item used to generate a response.

class BetaResponseLocalEnvironment:

Represents the use of a local environment to perform shell actions.

class BetaResponseMcpCallArgumentsDeltaEvent:

Emitted when there is a delta (partial update) to the arguments of an MCP tool call.

class BetaResponseMcpCallArgumentsDoneEvent:

Emitted when the arguments for an MCP tool call are finalized.

class BetaResponseMcpCallCompletedEvent:

Emitted when an MCP tool call has completed successfully.

class BetaResponseMcpCallFailedEvent:

Emitted when an MCP tool call has failed.

class BetaResponseMcpCallInProgressEvent:

Emitted when an MCP tool call is in progress.

class BetaResponseMcpListToolsCompletedEvent:

Emitted when the list of available MCP tools has been successfully retrieved.

class BetaResponseMcpListToolsFailedEvent:

Emitted when the attempt to list available MCP tools has failed.

class BetaResponseMcpListToolsInProgressEvent:

Emitted when the system is in the process of retrieving the list of available MCP tools.

class BetaResponseOutputAudio:

An audio output from the model.

An output message from the model.

class BetaResponseOutputItemAddedEvent:

Emitted when a new output item is added.

class BetaResponseOutputItemDoneEvent:

Emitted when an output item is marked done.

class BetaResponseOutputMessage:

An output message from the model.

class BetaResponseOutputRefusal:

A refusal from the model.

class BetaResponseOutputText:

A text output from the model.

class BetaResponseOutputTextAnnotationAddedEvent:

Emitted when an annotation is added to output text content.

class BetaResponsePrompt:

Reference to a prompt template and its variables. Learn more.

class BetaResponseQueuedEvent:

Emitted when a response is queued and waiting to be processed.

class BetaResponseReasoningItem:

A description of the chain of thought used by a reasoning model while generating a response. Be sure to include these items in your input to the Responses API for subsequent turns of a conversation if you are manually managing context.

class BetaResponseReasoningSummaryPartAddedEvent:

Emitted when a new reasoning summary part is added.

class BetaResponseReasoningSummaryPartDoneEvent:

Emitted when a reasoning summary part is completed.

class BetaResponseReasoningSummaryTextDeltaEvent:

Emitted when a delta is added to a reasoning summary text.

class BetaResponseReasoningSummaryTextDoneEvent:

Emitted when a reasoning summary text is completed.

class BetaResponseReasoningTextDeltaEvent:

Emitted when a delta is added to a reasoning text.

class BetaResponseReasoningTextDoneEvent:

Emitted when a reasoning text is completed.

class BetaResponseRefusalDeltaEvent:

Emitted when there is a partial refusal text.

class BetaResponseRefusalDoneEvent:

Emitted when refusal text is finalized.

class BetaResponseShellCallCommandAddedEvent:

A streaming event that indicated a shell command was added to a tool call.

class BetaResponseShellCallCommandDeltaEvent:

A streaming event that indicated a shell command was incrementally updated.

class BetaResponseShellCallCommandDoneEvent:

A streaming event that indicated a shell command was completed.

class BetaResponseShellCallOutputContentDeltaEvent:

A streaming event that indicated shell call output was incrementally added.

class BetaResponseShellCallOutputContentDoneEvent:

A streaming event that indicated shell call output was completed.

Literal["completed", "failed", "in_progress", 3 more]

The status of the response generation. One of completed, failed, in_progress, cancelled, queued, or incomplete.

class BetaResponseSteerAcceptedEvent:

Emitted when steering input has been validated and queued. Acceptance means the server owns the input, not that it has been applied. The successor’s response.created event is the commit point. If accepted input cannot be committed, response.steer.failed returns it with the same steering ID.

When the response stops for client-owned tool output or approval, the input remains queued and response.steer.pending is emitted after response.completed. Fill the pending event’s required_input stubs with saved results and send one matching explicit response.create per parent. Do not resend accepted input while it is still queued.

Union[Literal["response_not_found", "invalid_input", "steering_not_supported", 4 more], str]

A machine-readable steering error code. Clients should handle unknown values because additional codes may be introduced. Known values include:

  • response_not_found: The target response is not available on this connection.
  • invalid_input: The event or input failed validation.
  • steering_not_supported: The model or response execution mode does not support steering.
  • too_many_pending_steers: Too much steering input is pending for the response.
  • response_already_completed: The response completed and is no longer accepting steering input.
  • response_not_active: The response is no longer accepting steering input.
  • successor_creation_failed: The successor response could not be created.
class BetaResponseSteerEvent:

Queues user input to steer a response on this WebSocket connection. Input can contain text, images, and files. Steering is supported only for single-agent responses on models and execution modes that support steering. Responses bound to a conversation or using automatic compaction do not support steering.

A response.steer.accepted event acknowledges that the server owns the queued input, not that it has been applied. The successor’s response.created event is the commit point. Input that cannot be committed is returned in response.steer.failed.

Steering may cause the active response to finish at a safe output boundary with response.incomplete and incomplete_details.reason set to steered, followed automatically by a successor response.created. Normal completion can also be followed by an automatic successor. Automatic successors inherit the previous response’s settings and continue from it with the queued input.

If the response stops for client-owned tool output or approval, accepted steering input remains queued and response.steer.pending is emitted after response.completed. Fill the required_input stubs from that event with saved tool results or approval decisions, and send one explicit response.create per parent with the same previous_response_id and WebSocket lane. Do not rerun tools or resend accepted steering input. The queued input is prepended in submission order to that request’s input, and the explicit request retains its own settings.

This event accepts only type, previous_response_id, and input. Do not send stream_id; the target response determines the WebSocket lane.

class BetaResponseSteerFailedEvent:

Emitted when steering input is rejected or cannot be committed to a successor response. Returns the original, uncommitted input so the client can carry it into response.create when appropriate. Invalid input must be corrected before retrying.

Failures after acceptance include the same steering ID. Failures before an ID is allocated omit steer.id. A lost connection or missing acknowledgement leaves the outcome unknown; it is not proof that the input was rejected.

Union[str, List[Union[Dict[str, unknown], Dict[str, unknown]]]]

Input to queue for a continuation of the response. Uses the same string or input-item shape as response.create.input, with a non-empty array when supplying input items.

Steering accepts only messages with the user role. Each message may contain only type, role, and content, with content as a string or an array of input_text, input_image, and input_file parts. The optional type must be message. Other roles, tool outputs, and item types are not supported for steering.

A piece of message content, such as text, an image, or a file.

class BetaResponseSteerPendingEvent:

Emitted when accepted steering input remains queued after the target response completes. The server still owns the input. Do not resend it. The successor’s response.created event is the commit point.

When reason is waiting_for_required_input, this event follows response.completed while the response waits for the tool results or approval decisions identified by required_input. Copy those stubs, fill their result fields using the ordinary response.create input schemas, and submit one continuation per parent with the same previous_response_id and WebSocket lane. Use saved results without rerunning tools. The queued steering input is prepended in submission order to the continuation’s input. That explicit request retains its own settings.

This notification is emitted at most once per steering submission. Multiple submissions for the same parent can report the same required inputs; they do not each require a separate continuation.

Union[Literal["waiting_for_required_input"], str]

An extensible enum describing why accepted steering input is still queued. Clients should handle unknown values because additional reasons may be introduced. Known values include:

  • waiting_for_required_input: The response is waiting for the tool results or approval decisions identified by required_input.

An input stub identifying an outstanding client-owned tool result or approval decision. Copy the stub and fill the result fields using the corresponding response.create input schema. Use saved results without rerunning the tool. The server does not supply results, approval decisions, or safety acknowledgements in these stubs.

Event emitted while a response is streamed.

class BetaResponseTextConfig:

Configuration options for a text response from the model. Can be plain text or structured JSON data. Learn more:

class BetaResponseTextDeltaEvent:

Emitted when there is an additional text delta.

class BetaResponseTextDoneEvent:

Emitted when text content is finalized.

class BetaResponseToolSearchCall:
class BetaResponseToolSearchOutputItem:
class BetaResponseToolSearchOutputItemParam:
class BetaResponseUsage:

Represents token usage details including input tokens, output tokens, a breakdown of output tokens, and the total tokens used.

class BetaResponseWebSearchCallCompletedEvent:

Emitted when a web search call is completed.

class BetaResponseWebSearchCallInProgressEvent:

Emitted when a web search call is initiated.

class BetaResponseWebSearchCallSearchingEvent:

Emitted when a web search call is executing.

Client events accepted by the Responses WebSocket server.

Server events emitted by the Responses WebSocket server.

Optional[Literal["auto", "default", "flex", 4 more]]

Specifies the processing type used for serving the request.

  • If set to ‘auto’, then the request will be processed with the service tier configured in the Project settings. Unless otherwise configured, the Project will use ‘default’.
  • If set to ‘default’, then the request will be processed with the standard pricing and performance for the selected model.
  • If set to ‘flex’, then the request will be processed with the Flex Processing service tier.
  • To opt-in to Fast mode at the request level, include the service_tier=fast or service_tier=priority parameter for Responses or Chat Completions. The response will show service_tier=priority regardless of if you specify service_tier=fast or priority in your request.
  • If set to ‘ultrafast’, then the request will be processed with the access-controlled Ultrafast Processing service tier. This tier is currently available for gpt-5.6-sol; a response served through it will show service_tier=ultrafast.
  • When not set, the default behavior is ‘auto’.

When the service_tier parameter is set, the response body will include the service_tier value based on the processing mode actually used to serve the request. This response value may be different from the value set in the parameter.

class BetaSkillReference:

A tool that can be used to generate a response.

class BetaToolChoiceAllowed:

Constrains the tools available to the model to a pre-defined set.

class BetaToolChoiceApplyPatch:

Forces the model to call the apply_patch tool when executing a tool call.

class BetaToolChoiceCustom:

Use this option to force the model to call a specific custom tool.

class BetaToolChoiceFunction:

Use this option to force the model to call a specific function.

class BetaToolChoiceMcp:

Use this option to force the model to call a specific tool on a remote MCP server.

Literal["none", "auto", "required"]

Controls which (if any) tool is called by the model.

none means the model will not call any tool and instead generates a message.

auto means the model can pick between generating a message or calling one or more tools.

required means the model must call one or more tools.

class BetaToolChoiceShell:

Forces the model to call the shell tool when a tool call is required.

class BetaToolChoiceTypes:

Indicates that the model should use a built-in tool to generate a response. Learn more about built-in tools.

class BetaToolSearchTool:

Hosted or BYOT tool search configuration for deferred tools.

class BetaWebSearchPreviewTool:

This tool searches the web for relevant results to use in a response. Learn more about the web search tool.

class BetaWebSearchTool:

Search the Internet for sources related to the prompt. Learn more about the web search tool.

ResponsesInput Items

List input items
beta.responses.input_items.list(strresponse_id, InputItemListParams**kwargs) -> SyncCursorPage[BetaResponseItem]
GET/responses/{response_id}/input_items
ModelsExpand Collapse
class BetaResponseItemList:

A list of Response items.

ResponsesInput Tokens

Get input token counts
beta.responses.input_tokens.count(InputTokenCountParams**kwargs) -> InputTokenCountResponse
POST/responses/input_tokens
ModelsExpand Collapse
class InputTokenCountResponse: