Keep your knowledge base in step with your sitemap

Shipped

March 29, 2026

Area

Knowledge

Available on

Every plan

Your website keeps growing. You add a service page, publish a blog post, open a new location. If your AI agent learned your site from its sitemap a few months ago, it doesn't know about any of that, and finding the new pages by hand in a list of hundreds is slow. Now Studio remembers the sitemap you imported from and shows you only what's new.

What's new

When you import pages From Sitemap, Studio now keeps track of that sitemap. It appears under Sitemap Sources on the source's Website URLs tab, with how many of its pages you've imported and when you last checked it.

• Check for updates. One click reads the sitemap again and compares it with the pages already in your source.
• See only the new pages. Studio lists the pages that aren't in your source yet, for example "Found 4 new pages". Pages you already have aren't shown again, including ones added another way, such as a single URL.
• Import some or all of them. Pick the pages you want and click Import Selected, or bring in everything new with Import All.
• Know what's gone. If pages you imported earlier are no longer in the sitemap, Studio tells you how many, so you can decide whether to remove them.

How to use it

1. Open your chatbot in Studio and go to the Sources tab, then open a source. (You can also open Sources from the main menu.)
2. On the Website URLs tab, click Add Website, choose From Sitemap, and import the pages you want. Studio starts tracking that sitemap.
3. Later, find the sitemap under Sitemap Sources and click Check for updates.
4. Review the new pages and click Import Selected or Import All.

If nothing has changed, you'll see All caught up! with the number of pages already imported.

Good to know

• You decide when to check. Studio doesn't import new pages on its own. Nothing changes in your knowledge base until you import.
• It finds new pages, not edited ones. Pages already in your source aren't re-read when you check. To refresh a page whose content changed, re-add it.
• Nothing is removed for you. Pages that dropped out of the sitemap stay in your source until you delete them.
• Removing a tracked sitemap keeps your pages. You can stop tracking a sitemap at any time; the pages you imported from it stay where they are.
• Pages that couldn't be read don't keep coming back. A page that failed to import before (for example, one that only renders in the browser) isn't listed as new on every check.
• Large sitemaps work too. Big imports are sent in batches. See large sitemap imports, and the website sources guide.