Crawling Model

This topic explains the relationship between the different SQL queries and their effect on Full and Incremental crawls (of items):

Status Types

• No Index:
  • Item was crawled but not added to the index.
  • Appears as success and remains in the crawl database, but it is not searchable.
• Not Crawled:
  • Item was not crawled
  • There is no record in crawl database or index.
• Deleted:
  • Item is removed from the index using the "Do Not Index" flag, and still shows as a success but it is not deleted.
• Indexed:
  • Item is added to the index
• Updated:
  • Item's information is updated in the index.

Full Crawl

Item	Enumerator SQL	Definition SQL	Result
A	Not Found	Not Found	Not Crawled
B	Found	Not Found	No Index
C	Not Found	Found	Not Crawled
D	Found	Found	Indexed

Incremental Crawl

The following table displays 2 items: 'A' and 'D'.

One item was previously crawled and one wasn’t.

Item	Enumerator SQL	Definition SQL	Additional Change SQL	Result
A	Found	Found	Not Found	Indexed
A	Found	Not Found	Not Found	No Index
A	Not Found	Found	Found	Not Crawled
D	Found	Found	Not Found	Updated
D	Not Found	Found	Found	Updated
D	Not Found	Not Found	Found	Deleted
D	Found	Not Found	Not Found	Deleted
D	Not Found	Not Found	Not Found	No Change
D	Not Found	Found	Not Found	No Change