Crawling

Content Chimera can import assets in two ways: crawling and importing (see Data Sources). Whereas most crawlers are optimized for either one or both of: a) SEO or b) generating lists of URLs, Content Chimera’s crawler is optimized for gathering content useful for content decisions. Furthermore, it is built for large crawls and to give visibility into the crawl status.

Starting a crawl

To start a crawl, go to the Assets & Metadata page and click on the Start Crawling button.

../_images/start-crawling.png

In the majority of cases the defaults are sufficient (see Crawl Options).

Note

You don’t necessarily have to know more about crawling than how to click on Start Crawling. The information below is especially useful for larger crawls or if you run into any issues.

The steps of crawling

If the crawl is running successfully, you will see three progress circles (with some activity in at least the first circle), “Status: Running”, and the circle next to the Cancel button will be changing:

../_images/crawl-circles.png

When you first start the crawl, it will go through the following statuses (it may happen so fast that you do not see all the steps before Running):

  1. Unknown

  2. Queued

  3. Running

There are a couple other normal statuses (these statuses happen after clicking Cancel):

  1. Requested Termination

  2. Successfully Terminated.