Enumerate Items to Index

Use the Item Enumeration tab to enter the enumeration information for the items to index.

  1. In Connectivity Hub, click Content Sources.
  2. Open your content source Content Sources do the following: Receive data from the Source System via the Connection, Filter the data it receives, Provide the results to the Target, Define the specific search index that contains the content you wish to index (and later search). for editing.
  3. Click the Item Enumeration tab.
  4. Enumeration Query: Enter an SQL statement that returns a list of items to be indexed. If your data contains a last update date, Connectivity Hub can leverage that date to do high speed incremental updates. If not provided, every crawl will fully refresh the index. After entering your SQL, click the Test and Load Metadata Provides context with details such as the source, type, owner, and relationships to other data sets. Metadata provides details around the item being crawled by Connectivity Hub. link above the entry box to validate your query and pre-load the "Select Column" quick-pick boxes.
    • Definitions:
      • SPW_ID:
        • A required column and is the unique ID of the item.
      • SPW_SUBID:
        • An optional column and can be used in combination with SPW_ID to support combination IDs.
      • SPW_LASTUPDATE or SPW_LASTUPDATEUTC:
        • Only required if you are supporting incremental indexing and a suitable last update field is available.
        • Use the UTC version if the data is stored as UTC in your database.
      • SPW_CURRENTDATEUTC:
        • An optional and recommended if your database is in a different time zone than your index server.
        • Have this value return the current UTC Date on that database, that is, GetDateUTC() as SPW_CURRENTDATEUTC.
        • @SPW_LASTUPDATE or @SPW_LASTUPDATEUTC is an optional parameter, but must be provided if you want to support incremental updates.
        • Use the UTC option if your source data update date is stored as UTC.

      • Use brackets [] to specify the value of a column returned by a SQL statement.
        Sample:

        Copy
        select id as SPW_ID, pid as SPW_SUBID, fileext, getdate() as SPW_CURRENTDATE, lastupdate as SPW_LASTUPDATE 
        from table where lastupdate > @SPW_LASTUPDATE order by SPW_

        Note: The Item enumerator returns a list of changed items, but does not differentiate among Add/Modify/Delete actions. Handle these cases in the SQL itself.

        Note: You can also enumerate items to be loaded for incremental crawls Scanning and capturing only new data from all of your content sources. This data did not exist when the last crawl was run. using the Additional Changes SQL field on the "Advanced" tab under "Content."

  5. Item Extension:
    1. This is the associated extension of your item in the index and determines the icon that is displayed in the search results.
    2. If the output extension is not in the list of the accepted File Types in the search admin, it is skipped.
    3. It is also the default extension used for any unstructured files that don't explicitly have an extension, like blobs.
  6. Check Case Sensitive ID if either ID or SubID is case sensitive.
  7. Click Save.