Settings Overview
This screen lets you configure Schema Manager to discover your website pages, upload your own web pages, recrawl pages to include fresh content, and append or add new URLs while retaining the existing URLs that have already been crawled. Once the Schema Manager has been connected to your website, you can choose how you want to fetch the page URLs from the below options:
URL Settings:
You can either upload your own set of URLs for schema tagging or you can trigger an auto-discovery process that automatically fetches URLs. The following options are available.
Discover & Crawl URLs - Allow the system to automatically crawl and auto-discover pages
Upload your own - Allow the system to manually upload a list of pages
Append - Add URLs while retaining the existing URLs
Recrawl - Recrawl existing URLs to update their content
Once you have selected the user agent and URL settings option, click on ‘Start Crawl’ (except for the Upload option) to initiate fetching of URLs in Schema Manager. The process might take some time to complete based on the number of existing website pages. For the 'Upload' and 'Append' option you have to upload the list of URLs.
Clear CDN Cache
On the right side of the Settings in Schema Manager, you will find the new CDN Cache section. You can click on ‘Clear CDN Cache’ to clear the cache when you’ve added a new schema to the page.
Note: Updating for CDN cache can take some time depending on the number of URLs scheduled for schema deployment.
Quick last crawl details
The Crawl History shows you what was the last crawl action taken on the URLs - when was it done and by whom.
Download Current URLs
You can use the Download Current URLs to download the URLs that have been crawled and are getting tagged. You can also see when the last time URLs were downloaded.
Note: The URLs which are listed under schema audit for tagging appear in the current URL list. These are those URLs that were 200 OK when they were initially crawled.