Braintrust

Braintrust is an AI engineering platform for managing prompts, datasets, experiments, evaluations, observability, and production AI applications.

17 actions Integration catalog
Request access
Connect Braintrust once you're in Boring.
01 · WHAT THE AGENT CAN DO

Actions

Every capability is a discrete, logged action the agent calls by name — scoped to what you authorize and recorded in the run trace.

Create DatasetBRAINTRUST_CREATE_DATASET
Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
Create ExperimentBRAINTRUST_CREATE_EXPERIMENT
Create an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensure_new is true, which creates an experiment with a unique name.
Create ProjectBRAINTRUST_CREATE_PROJECT
Create a Braintrust project, or return the existing project unchanged when its name already exists.
Create PromptBRAINTRUST_CREATE_PROMPT
Upsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the stored prompt configuration with the submitted configuration. MCP attachments and tool-function bindings are unsupported.
Delete ProjectBRAINTRUST_DELETE_PROJECT
Soft-delete a Braintrust project and return its deletion state.
Delete Experiment, Dataset, or PromptBRAINTRUST_DELETE_RESOURCE
Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
Fetch EventsBRAINTRUST_FETCH_EVENTS
Fetch one newest-to-oldest page of project log, experiment, or dataset events.
Get Braintrust ResourceBRAINTRUST_GET_RESOURCE
Get one project, experiment, dataset, prompt, or function by UUID.
Insert Dataset EventsBRAINTRUST_INSERT_DATASET_EVENTS
Upsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
Insert Experiment EventsBRAINTRUST_INSERT_EXPERIMENT_EVENTS
Upsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
List Braintrust ResourcesBRAINTRUST_LIST_RESOURCES
List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
Query Braintrust DataBRAINTRUST_QUERY_DATA
Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later pages by passing the returned next_cursor unchanged.
Summarize Experiment or DatasetBRAINTRUST_SUMMARIZE_RESOURCE
Return metadata and optional aggregate summaries for one Braintrust experiment or dataset.
Update DatasetBRAINTRUST_UPDATE_DATASET
Update the name, description, tags, or metadata of a Braintrust dataset. At least one non-null mutable field is required.
Update ExperimentBRAINTRUST_UPDATE_EXPERIMENT
Update selected metadata and linkage fields on a Braintrust experiment. At least one non-null mutable field is required.
Update ProjectBRAINTRUST_UPDATE_PROJECT
Update selected fields of a Braintrust project. At least one non-null mutable field is required: name, description, or settings.
Update PromptBRAINTRUST_UPDATE_PROMPT
Update a Braintrust prompt's metadata or configuration without invoking it. At least one non-null mutable field is required.