What is a Content Source?

 

About Content Sources

Content Source is a component of Connectivity Hub that is responsible for the following operations:

  • Receives data from the Source System via the Connection
  • Filters the data it receives.
  • Provides the results to the Target
  • Defines the specific search index that contains the content you wish to index (and later search).
    • In the example shown below, this is "Search Index A."
  • Maps the properties of the data from your source system to a defined property set (which you define).
    • In the example below, the Elasticsearch properties from your Source System are mapped and stored as a schema in "Search Index A"

Content Source's Role in Indexing Data

  • Your documents, images and other items, stored in a Source System (SharePoint Online, Documentum, etc.), flow through the Connector Web Service and into a specific search index managed by a search application instance, such as Elasticsearch.
  • While the Target points to an instance of a search application (Elasticsearch), the Content Source specifies exactly which search index to use within the search application instance.
    • In the diagram below, data from your source system is routed specifically into "Search Index A" of the Elasticsearch search application instance.
  • In the following diagram, the flow of data from one of your Source Systems (such as File Share, SharePoint Online, etc.) to a specific search index is shown.

Content Source Types

Connectivity Hub includes the following types of Content Sources:

  • External, Web service Content, such as:
    • SharePoint Online
    • SharePoint On-Premise
    • Documentum
    • File Share
    • OpenText
  • Built-in Database Content, such as OLEDB-type databases:
    • SQL
    • Oracle

Mapping Properties

In the example below the Connectivity Hub Target maps the following Elasticsearch properties from your Source System, and stores the mapping as a schema in "Search Index A":

Note that one property does not change, as it is not mapped to a different property.

  • Author->Name
  • Title->Label
  • Date->Date

    • For more information about Elasticsearch mapping, see Elastic Schema.

    • Accessing Content Sources in Connectivity Hub

    Content sources are listed in BA Insight Connectivity Hub on the Content Sources dashboard, available from the top horizontal menu.

    See the graphic below. 

    How to Add Content Sources

    Content sources can be added from multiple locations:

    Content Source Example

    In this example, a File Share Content Source is described, including its

    • Type:
      • Web service content type (as opposed to a SQL (database) content type)
    • Connection
      • Named "FileShares", this is the Connection the Content Source is associated with.
      • This Connection includes the path to the Connector web service (web service URL http://server:port/DataConnector.asmx).
    • Target:
      • Points to the search application instance named "TestFileShare Target".
    • Target Index:
      • Named "filesharescontent".
      • This is the specific index in the search application instance.