Crawlbase
Crawlbase provides APIs for crawling web pages, managing crawler queues, storing crawl results, and monitoring account usage.
8 actions Integration catalog
Request access
Connect Crawlbase once you're in Boring.
01 · WHAT THE AGENT CAN DO
Actions
Every capability is a discrete, logged action the agent calls by name — scoped to what you authorize and recorded in the run trace.
Crawl URLCRAWLBASE_CRAWL_URL
Fetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return its content with separate target and Crawlbase statuses.
Delete Stored PagesCRAWLBASE_DELETE_STORED_PAGES
Irreversibly delete explicitly selected pages from Crawlbase Cloud Storage by request ID and return each page's deletion outcome.
Generate User AgentsCRAWLBASE_GENERATE_USER_AGENTS
Generate one to ten realistic randomized User-Agent strings for a selected device class.
Get Crawling UsageCRAWLBASE_GET_CRAWLING_USAGE
Return current Crawling API usage and optionally previous-month statistics for the connected Crawlbase account.
Get Storage CountCRAWLBASE_GET_STORAGE_COUNT
Return the number of pages currently held in Crawlbase Cloud Storage.
Get Stored PageCRAWLBASE_GET_STORED_PAGE
Retrieve the latest Crawlbase Cloud Storage page by exactly one request ID or original URL.
Get Stored PagesCRAWLBASE_GET_STORED_PAGES
Retrieve up to 100 Crawlbase Cloud Storage pages by request ID without deleting them. Returns decoded page content and identifies requested IDs that were not found.
List Stored Page IDsCRAWLBASE_LIST_STORED_PAGE_IDS
Return one page of Crawlbase Cloud Storage request IDs and a short-lived continuation cursor.
// also in ai web scrapingsee all AI Web Scraping Tools →
Agentql
AgentQL is a suite of tools designed to connect AI agents to the web, enabling web interaction and structured data extraction through a specialized query language.
Agenty
Agenty is a web scraping and automation platform that enables users to extract data, monitor changes, and automate browser tasks without coding.
Airtop
Airtop provides cloud browsers and AI-powered web automation for navigating sites, interacting with pages, extracting data, and running reusable browser workflows.
Anakin
Anakin provides web scraping, crawling, search, browser automation, monitoring, and pre-built website actions for AI agents.