30 days free. No credit card. Full access from the moment you connect your site.

Start free trial

Get The Crawler Sitemap

litespeed/get-crawler-map returns a page of the sitemap the crawler works from, along with the total URL count.

If it is empty, the crawler has nothing to do — which is the usual explanation for a crawl that appears to finish instantly.

At a glance

Abilitylitespeed/get-crawler-map
ToolsetLiteSpeed Cache — toolset/litespeed
GroupLiteSpeed Cache › The Crawler
RequiresLiteSpeed Cache, active on the site
Capabilitymanage_options
SafetyRead-only — changes nothing
RepeatableIdempotent — running it twice leaves the same result
Ships inAcrossAI Abilities Manager 0.0.34 and later

How it works

The crawler does not discover pages. It works from a stored map, generated from the sitemap the configuration points at, and if that generation never ran or produced nothing, the crawler runs correctly over zero URLs and reports success.

That is a confusing state: the crawler is enabled, runs on schedule, completes every time, and warms nothing. The total count here is the one number that makes it obvious.

It is also worth reading for size. A map of a hundred thousand URLs will not be crawled within any useful interval, and the practical answer is a narrower sitemap rather than a more aggressive crawler.

Paging is by limit and offset, because the whole map is rarely what you want.

Input

NameTypeRequiredWhat it is
limitintegerNoHow many URLs to return.
offsetintegerNoWhere to start.

What comes back

NameTypeWhat it is
urlsarrayA page of the sitemap.
totalintegerHow many URLs the map holds in total.
successbooleanWhether the call completed.
messagestringA one-line summary of what happened, suitable for showing a human.
error_codestringPresent only on failure — a stable machine-readable reason, such as a missing field, a wrong field type or an unmet confirmation.

Example

Ask your assistant:

What is the crawler actually going to visit?

It resolves to one call:

{
  "ability": "litespeed/get-crawler-map",
  "parameters": {
    "limit": 20
  }
}

Worth knowing

  • An empty map explains a crawl that finishes instantly.
  • A very large map will never be fully crawled on a normal interval.
  • The crawler does not discover pages — it reads this map.

Related abilities


Get the plugins:
AcrossAI Abilities Manager · AcrossAI MCP Manager

Browse the rest: Every ability, by category


Keep reading