LLM API

Request best-effort cancellation of an in-progress batch. Return the provider's actual batch state without implying cancellation took effect; work may still finish and incur charges before the request is applied.

Count input tokens for an Anthropic-compatible message request without generating a model response.

Generate one complete, non-streaming Anthropic-compatible message with flexible content blocks, system prompts, and tool use.

Generate a complete, non-streaming OpenAI-compatible chat response from role-based messages, optionally using tools, multimodal content, structured output, reasoning, or web search supported by the selected model.

Create vector embeddings for one text or a batch of texts with a selected embedding model.

Generate one complete, non-streaming OpenAI Responses-compatible result from text or structured input, preserving reasoning and tool items.

Permanently delete a caller-owned or explicitly authorized project file. This destructive operation cannot be undone; a missing file fails with not found rather than reporting a successful deletion.

Return one model's full live capabilities by ID, or browse a compact, bounded view of the live model catalog using local capability filters.

Return the connected user, project, organization, purchased and bonus credit balances, funding mode, and balance gating in one account-status read.

Return one asynchronous batch and its latest lifecycle, token, and cost status by ID, or one provider-default page of project batches when no batch ID is supplied. List mode supports provider cursor pagination.

Return metadata for one project file by ID, or one provider-default page of project file metadata when no file ID is supplied. List mode supports purpose filtering and provider cursor pagination.

Create an asynchronous batch from an existing purpose=batch file ID, or upload a JSONL input file with purpose=batch and create the batch in one call.