Langfuse

Open source LLM engineering platform. Traces, evals, prompt management and metrics to debug and improve your LLM application.

10 actions Integration catalog

Connect Langfuse once you're in Boring.

01 · WHAT THE AGENT CAN DO

Actions

Every capability is a discrete, logged action the agent calls by name — scoped to what you authorize and recorded in the run trace.

Create ScoreLANGFUSE_CREATE_SCORE

Attach an evaluation score to exactly one Langfuse trace, session, or dataset run, optionally narrowing a trace score to an observation.

Get Annotation QueueLANGFUSE_GET_ANNOTATION_QUEUE

Retrieve one Langfuse annotation queue by its ID.

Get PromptLANGFUSE_GET_PROMPT

Retrieve a Langfuse text or chat prompt by name, deployment label, or exact version, with optional dependency resolution.

List Annotation QueuesLANGFUSE_LIST_ANNOTATION_QUEUES

List annotation queues configured for human evaluation in the connected Langfuse project.

List Dataset ItemsLANGFUSE_LIST_DATASET_ITEMS

List dataset items, optionally scoped to a dataset, source trace or observation, or historical dataset version.

List Dataset Run ItemsLANGFUSE_LIST_DATASET_RUN_ITEMS

List run items for a specific Langfuse dataset and run name.

List DatasetsLANGFUSE_LIST_DATASETS

List datasets available to the connected Langfuse project.

List ExperimentsLANGFUSE_LIST_EXPERIMENTS

List Langfuse experiments active in a required time range, optionally including metadata and directly attached scores.

List ModelsLANGFUSE_LIST_MODELS

List Langfuse-managed and project-custom model pricing definitions used for usage and cost calculation.

List ObservationsLANGFUSE_LIST_OBSERVATIONS

Search Langfuse observations such as generations, spans, events, agents, and tool calls, selecting only the field groups needed.

List ScoresLANGFUSE_LIST_SCORES

Search numeric, boolean, categorical, text, and correction scores with subject and annotation context.

Query MetricsLANGFUSE_QUERY_METRICS

Run an aggregate Langfuse metrics query over observations or numeric, boolean, or categorical scores.

Upsert LLM ConnectionLANGFUSE_UPSERT_LLM_CONNECTION

Create or update a Langfuse LLM provider connection by provider name.