Analytics Reports

About Out-of-the-Box Reports

By employing out-of-the-box reports you can view important analytics about the behavior of your users, and make valuable insights into your enterprise content.

You can view analytics about your SmartHub portal such as:

  • Search analytics
  • Query analytics
  • Content analytics
  • User analytics:
    • User behavior
    • User actions
    • Query patterns
    • And more!
  • Document Ratings
  • Chatbot Interactions

This page provides a high-level overview on the following topics:

The following information is referred to on the BA Insight website here: https://www.bainsight.com/smarthub-analytics/

Overview

  • SmartHub analytics utilizes an Elasticsearch backend The search engine your SmartHub instance uses to perform queries. SmartHub can be configured to use more than one search engine..

  • Kibana A source-available data visualization dashboard for Elasticsearch is used to generate the reports brought into the SmartHub Analytics browser-based UI.

  • Specifically, Kibana is a browser-based analytics and search dashboard for Elasticsearch.

  • To gain insights into your SmartHub environment, Kibana uses the data stored in the SmartHub elasticsearch backend to create visualizations

  • Kibana report visualizations are created and stored within a Kibana Dashboard

  • Kibana Dashboards and the visulaizations they contain are ported into the SmartHub analytics browser-based UI for consumption by business analysts, IT admins, management, etc.

  • Contact Upland support for assistance.

  • IMPORTANT! The easiest way to begin building reports is by using an existing report and modifying it's parameters to achieve the results you desire.

  • Kibana offers you the ability to preview the results of your analytics report in Kibana before deploying it to your preferred

  • BA Insight recommends you examine existing reports as well as your own specific goals and requirements

Recommended Educational Materials

Note: Note: SmartHub Analytics v5.6 uses Kibana v7.10.

Browser Support

Each of the analyses for the query, visit, and content operations that are performed on your site, is available using the following browsers:

  • Internet Explorer v11, and above
  • The latest:
    • Safari
    • Chrome
    • Firefox

Built-in Reports

Portal Analytics

Portal Analytics focuses on user actions, visits, page loading times, and volume.

  • Visits Volume: Top sites based on visits count, visit activity over time and total number of visits.

    • Information on the visitors is also provided, such as unique number of visitors, geolocation, and top browsers.

    Caution: (Later versions of Chrome used with Analytics on-premise, only), the Visits Location table might report that no results are found. This is a Chrome issue.

  • Visits Duration: Allows evaluation of visits duration by site.
  • Page Visits: Shows the popularity of entry pages as well as visited pages from the site collection, characterized by page hit count, most frequent visitors and average page visit duration.
  • Page Load Time: Allows evaluation of load time for all pages in your site collection by parameters such as minimum, maximum, average and evolution over time.
  • Popular User Actions: Popular user actions and sites based on user activity.
  • Visits Insights: Displays users and departments visiting the portal the most, as well as top locations from where the portal is visited from.

Search Analytics

  • Usage: The number of search sessions per search center.
  • Query Volume: A count of the most frequently issued queries per site.
  • Most Popular Content: A count of the number of times the most frequently accessed content was reached per site.
  • Most Popular Sources: A count of the most frequently accessed content sources, based on the number of times that content was accessed on each site.
  • Content Interaction: A measure of the user actions on content query results including click-throughs, opens, edits, and shares.
  • Findability Scorecard (by Search Center): Grading and key performance analytics per site.
  • Query Scorecard (by Query): Grading and key performance analytics per site

Key Performance Analytics Per Site

  • Search Efficiency:
    • The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.
  • Content Interaction:
    • The distribution of user actions on content such as clicking through, opening, editing, and sharing.
  • Average SearchQuality:
    • A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.
  • Average Progress: 
    • The distribution of user actions on content such as clicking through, opening, editing, and sharing.

Grades

  • A: Many more content actions then search actions, no issues. Search is working and returning the content that users are seeking.
  • B: More content actions then search actions, with issues.  Search is not working well, but users are still finding the content they are seeking.
  • C: Less content actions then search actions, no issues. Search is working, but users are not finding the content they are seeking.
  • D: Far less content actions then search actions, with issues. Search is not working and users are not finding the content they are seeking.

User Analytics

User Analytics displays the measures of how specific users are searching and accessing content, including the sites where this content is located, during an ad-hoc time interval.

  • Popular Queries: The aggregate usage frequency of the related query term for a specified query across all users.

  • Query Trends:
    • The query trends for a list of specified users on a per search basis that spans all searches.
      • Key performance analytics per site:
        • Average Efficiency:
          • The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.
        • Average Experience:
          • The compilation of Content Interaction, Search Efficiency, and Search Issues scores.
        • Average Progress:
          • The distribution of user actions on content such as clicking through, opening, editing, and sharing.
        • Average SearchQuality:
          • A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.
  • Query Patterns:
    • The identified query patterns for a list of specified users on a per search basis that spans all searches.
      • Key performance analytics per site:
        • Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.
        • Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.
        • Average Progress: The distribution of user actions on content such as clicking through, opening, editing, and sharing.
        • Average SearchQuality: A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.
  • Query Audit Trail: The list of all of the query terms that were entered by the specified user.

Key performance analytics per site:

Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

  • Content Audit Trail: The list of all of the content that the specified user accessed.

  • Search Session Activity: The search activities throughout a search session (from query to content interactions) for a specified user.

Key performance analytics per site:

Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

Average Progress: The distribution of user actions on content such as clicking through, opening, editing, and sharing.

Average SearchQuality: A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.

  • Productivity Score: Productivity is an overall grade based on search efficiency (where search originates with queries and concludes with content operations) and technical issue occurrences.

Key performance analytics per site:

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

  • Search Session Usage Patterns: Action patterns taken on search results (where search originates with queries and concludes with content operations) for a list of specified users on a per session basis that spans all search sessions.

Key performance analytics per site:

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

  • Work Relationships Page: Shows the list of managers and the employees managed by.

  • User Insights: Displays the most active users and their distribution by department, job title, time zone, and office location.

Query Analytics

Query Analytics displays analyses of query terms and the query results during an ad-hoc time interval, that can be used to tune the search center.

  • Most Popular Query Terms: A ranked, searchable list of all occurrences of the entered query terms.

Key performance analytics per site:

Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

Average Progress: The distribution of user actions on content such as clicking through, opening, editing, and sharing.

Average SearchQuality: A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.

  • Most Successful Queries: A measure of user actions on content such as clicking through, opening, editing, and sharing.

  • Related Queries: A list of query terms that were issued by the same user in a single search session.

  • Queries by User: A list of users and the queries that each user issued.

  • Content Click-Throughs: A list of the content that was most frequently accessed for a specific query.

  • Content Click-Through Positions: A list of the content that was accessed according to position in the search results list.

  • Suggested Query Usage: A distribution of query suggestions used across sites.
  • Saved Query Usage: Top saved queries, usage over time and top users that interact with them.

Content Analytics

Content Analytics displays the accessed content and their sources along with the sites where this content is located, during an ad-hoc time interval.

  • Popular Content: A ranked, searchable list of all of the accessed content.

  • Popular Content Sources: A measure of the number of times a user accessed content from the specified content source.

  • Query-Content Interactions: A list of the queries that resulted in users clicking through, opening, editing, and sharing content.

  • Content Interactions, by user: A history of the user interactions with content such as clicking through, opening, editing, and sharing.

  • Content Interactions, all users: A history of the user interactions with content such as clicking through, opening, editing, and sharing.

  • Actions Insights: Distribution of actions by department and users.

Search Diagnostics

Search Diagnostics focuses on the lowest rated interactions and queries, during an ad-hoc time interval.

  • Unsuccessful Queries: A list of queries with the lowest rates of user click-throughs.

Key performance analytics per site:

Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

Average Progress: The distribution of user actions on content such as clicking through, opening, editing, and sharing.

Average SearchQuality: A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.

  • User Analytics: A list of users who have the lowest percentages of actions on content; such as clicking through, opening, editing, and sharing.

Key performance analytics per site:

Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.

  • Query Quality: A list of the issues that occurred as queries were executed.

  • Search Quality: A list of the technical search issues including searches that return zero results, searches with low ranked click-through rates, slow searches (high latency), and time outs (service errors).

  • Least Effective Sessions: Search sessions that resulted in the fewest actions on content such as clicking through, opening, editing, and sharing.

Key performance analytics per site:

Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

Average Progress: The distribution of user actions on content such as clicking through, opening, editing, and sharing.

Average SearchQuality: A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.

  • Query Grades: A grade for all of the specified queries, including the cause of the grade:

Grades:

    • A: Many more content actions then search actions, no issues.
    • B: More content actions then search actions, with issues.
    • C: Less content actions then search actions, no issues.
    • D: Far less content actions then search actions, with issues.

Key performance analytics per site:

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

  • Search Grades:
    • A grade for all of the search operations, as these searches originate with queries and conclude with content operations:

Grades:

    • A: Many more content actions then search actions, no issues.
    • B: More content actions then search actions, with issues.
    • C: Less content actions then search actions, no issues.
    • D: Far less content actions then search actions, with issues.

Key performance analytics per site:

Average Efficiency: The measure of how quickly users were able to act on content such as clicking through, opening, editing, and sharing.

Average Progress: The distribution of user actions on content such as clicking through, opening, editing, and sharing..

Average SearchQuality: A report of the issues and errors that occurred during search interactions including slow results, no results, or system errors.

Refiners Analytics

Refiners Analytics focuses on the use of refiners and the related user experience.

  • Refiner Usage by site: The list of the most popular refiners and refiner values.

  • Refiner Usage by query: The list of query terms that are frequently used with refiners.

  • Refiner Experience: How the usage of Refiners influence search experience.

Key performance analytics per site:

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores.

  • Popular Refiner Configurations: Popular Refiner configurations (types), usage and how they influence queries.

  • Refiner Actions Usage: User interaction with the most common Visual Refiners action types.

  • Refiner Experience Evolution: How the usage of Refiners influence search experience over time.

Key performance analytics per site:

Average Experience: The compilation of Content Interaction, Search Efficiency, and Search Issues scores

Smart Preview Analytics

Smart Previews Analytics focuses on previews and workspace usage and the related user experience.

  • Preview Activity: Analyze the most previewed documents and pages. Monitor average of previewed pages over time and other feature usage such as “Search Inside”.

  • Workspace Activity: Which users have workspace activity and which documents are the most popular from this perspective.

  • Previewed Documents: Analyze the most previewed documents in your site collection by preview count, frequency of preview over time, and size of documents.

  • Preview Load Time: Analyze the preview load time of most previewed documents for each search site.

  • Queries Leading to Previews: How the usage of queries influence document previews.

  • Previewed Documents Detail: Analyze what users look at.

Document Ratings

Document Ratings focuses on content source and document quality.

  • Content Source Quality: Average ratings for the available content sources.
  • Document Quality: Average ratings for the available documents.

Chatbot Interactions

Chatbot Interactions focuses on different ways the user can use the Chatbot.

  • Chatbot Interactions: Chatbot interactions details.
    Interactions tracked: