How to Migrate to the Latest SharePoint Online Connector

About

Follow the steps below to migrate to from the BA Insight SharePoint Online v1 connector to v2.

Install the SharePoint Online Connector

Install the new SharePoint Online v2 connector.

Before proceeding, ensure you unblock the connector .zip file.

  1. Double-click the connector MSI file to launch the wizard.
  2. Follow the steps in the wizard.
  3. Complete all necessary fields.

Reset IIS

  1. Launch a Command prompt with Admin privileges.
  2. Run the command “iisreset.”
  3. Close the Command prompt.

Set Up a New Connection

Filtering

  • Enter the site collections in the Datastore Sync Settings instead of the Site Collection Filter.

Site Collection Filter (v1 of connector)


Datastore Sync Settings (v2 of connector)

Use the applicable filter site method below. Only one method is required.

  • Filter site collections by URL.

  • Filter site collections by title

  • Filter site collections by template ID

Autofetch Functionality

  • In v2 of the SharePoint Online connector, the "Autofetch" check box has been removed.

  • The decision to retrieve all datastores in your tenant is made by the connector, depending on the datastore filter entered.

Examples

  • Site collection URL filter:
    • “include=https://contoso.sharepoint.com/sites/ACSPO" → ACSPO site collection returned. No autofetch performed.
    • “include=https://contoso.sharepoint.com/sites*” → Autofetch returns all site collections in the tenant
    • “exclude=https://contoso.sharepoint.com/sites/GeorgeM” → Autofetch returns all sites in the tenant except for "GeorgeM"
  • Site collection URL filters:
    • include=https://contoso.sharepoint.com/sites/* exclude=https://contoso.sharepoint.com/sites/GeorgeM” → Autofetch is performed
  • Any Site collection Title filter entered → Autofetch is performed
  • Any Web Template ID filter entered → Autofetch is performed
Note: The user need not be concerned with Autofetch.
This functionality has been moved behind the scenes and the user can focus solely on the site collection filters

Removed Options

The following options have been removed from version 1 of the connector:

  • "Synchronized domain"
  • "Compound delimiters"
  • "Native properties" (rendered irrelevant)

Run the Datastores Load Job

After you set up your connector's connection, you must run a datastores load job.

  1. Navigate to the Tasks tab.
  2. Create a new task for your connection.
  3. Select the Datastores Load job.
  4. Create Create.

  5. Verify the job runs successfully.
    1. On the Connections tab, under the Actions drop-down for your connection, select the Datastores Load option.
    2. Validate that all of the expected site collections are shown and set to active.

Run the Datastores Types Load Job

  1. Navigate to the Tasks tab.
  2. Create a new task for your connection.
  3. Select the Datastores Types Load job.
  4. Create Create.



  5. Verify the job runs successfully.
    1. On the Connections tab, under the Actions drop-down for your connection, select the Datastores Types Load option.
    2. Validate that all of the expected site collections are shown and set to active.

Run the Security Sync Job

The security setup is similar to that of the v1 connector.

  1. Run the Security Sync job.
  2. Validate your security map.
  3. For assistance, contact BA Insight support.

Create a New Content Source

Site Content Filter

  • Datastores in the SharePoint Online v2 connector are site collections (the top-level sites) only, and not sites.

  • To support retrieving content from only specific sites, a SITEURL content filter can be used in the Custom Filters field.

Example

  • In version 1, you can crawl a specific sub-site via the Datastores list (v1 below).
  • In version 2, this is configured in the content source using a custom filter (v2 below)

SharePoint Online O365 v1

Latest SharePoint Online

Metadata

  • Metadata generation in SharePoint Online v2 is generated using METADATANAME

  • Metadata generation in SharePoint Online v2 is not generated using the format PARENTCONTAINER_METADATANAME

  • For this reason you see a significantly lower number of properties after the Datastore Types Load job completes.

SharePoint Online Connector v1


SharePoint Online Connector v2


Crawling Published/Draft Items

Crawling Published/Draft documents in document libraries:

  • Version 2 of the connector replicates the permissions of standard readers in SharePoint.

    • For instance:

      • If readers are only allowed to view published content:

        • The connector indexes the latest published version for a given document.

      • If readers are allowed to view draft content:

        • The connector indexes the latest draft version available for a given document.

Info: The connector behavior is dictated by the settings set at the document library level.

Crawling Previously Indexed Content

  • In version 2 of the connector, the only site collections are the datastores.
  • Content that was previously crawled with version 1 of the connector must be recrawled with version 2.
  • In version 2 of the connector, the sub-sites of a site collection are returned as items.

Remove SharePoint Online v1 Components (Optional)

  • You can now delete/remove SharePoint Online v1 components from your Connectivity Hub.

  • This is completely optional.

  • This includes your SharePoint Online v1 connector:

    • Connection
    • Content Source
    • Any datastore load or datastore types load jobs.
    • Security information such as security map, etc.

Uninstall the SharePoint Online v1 Connector

On the server your connector is installed on, perform the following steps:

  1. Open the Windows Control Panel.
  2. Select Add/Remove Programs>Uninstall a program>BA-Insight SharePoint Online Connector.
  3. When finished, close the window.