Feature Update: Page Inventory

We are excited to announce an update to our Page Inventory feature.

Cludo has updated Page Inventory!

We are excited to announce an update to our Page Inventory feature.  

What does Page Inventory do?

Page Inventory provides you with an overview of your indexed content. The Page Inventory feature gives you:

  • An overview of indexed content (web pages and files) across all websites 
  • An overview of all crawlers 
  • The ability to delete pages from being indexed again   
  • The option to recrawl pages within the feature 

So, what changed?

During product research, we came to realize our old Page Inventory feature provided a very minimal overview of what pages and documents were indexed in your last crawl. If your content hadn’t changed much between crawls, it could sometimes lead to confusion due to little-to-no change in Page Inventory numbers. 

We have enhanced the feature in order to provide a more detailed overview of your indexed content. With these changes, your Page Inventory: 

  • contains all indexed pages and documents no matter whether they were updated in the latest crawl or not (which is the biggest change in comparison to the old Page Inventory
  • allows you to view content by engine, crawler, domain and page type
  • can compare what content was last indexed to what content is live on your website
  • helps you identify and exclude pages that you no longer want indexed
  • can recrawl pages on demand

The new look

We wanted to make a feature that provided more thorough and detailed information. In order to do that, Page Inventory is now divided into three page views: the main page view, specific page analysis and crawler summary 

Main page view provides an overview of your indexed content (pages and documents) across all websites. Here you will be able to filter content by engine, crawler, domain and page type. You can also remove pages from the index on this page. 

Page analysis new UI

Specific page analysis is where you can see indexed information per page and can delete pages from being indexed again. You can also compare “live values” of the page. If they are different to what is currently indexed, you can easily run a recrawl to match the live values. 

Page analysis 2 new UI

Crawler summary is a separate, high-level overview of all crawlers. Here you can review total pages indexed, how many of those pages are web pages or files and when the last crawl ran. 

Crawler Summary New UI


Did you discontinue the old Page Inventory feature?

No, the old Page Inventory feature is now called Crawler Activity and can be found in the Content section of MyCludo. 

Why does Page Inventory matter?

Page Inventory is essentially a product health checkup. It enables you to quickly and easily analyze the status of your site search, and ensure that it is pulling and delivering all the right content to your website or intranet search users. This enables you to both keep track of how much content you have, as well as identify and troubleshoot any issues your search may be experiencing in a timely manner. 

For example, if you find a discrepancy between the amount of content you want indexed and the number of pages you’re seeing in the Page Inventory, you’ll know that something has gone wrong. On the other hand, perhaps you’ll find that there is way too much content being indexed- in this case you can check to see if perhaps the incorrect domains have been set up to index from. This is an important alert- especially if you’re accidentally indexing content that should not be searchable, or publicly available! 

On a more granular level, this feature also has SEO implications. By identifying what content is missing titles, descriptions, or other fields, it will help you to rectify problems and optimize your content for external search engines like Google. By eliminating crawling errors and missing information, you’ll better prepare your site for ALL search engine crawlers, which can only benefit your organization. 

To learn more about accessing and using this useful tool, please visit the Page Inventory section of our help center by clicking here

Note: this blog post was updated on July 23, 2020 to reflect changes to the Page Inventory feature. 

Similar posts

Get notified on new content from Cludo

Be the first to know about the world of search and analytics. 

Subscribe now!