Configure the OpenAI Topic Splitter tuning stage

Configure the OpenAI Topic Splitter query tuning stage to enable SmartHub to detect, split, and process multi-topic user queries in parallel. These settings control how sub-queries are generated, executed, logged, and recombined into a single coherent response.

Prerequisites

Note the following prerequisites before configuring the AI Visual Interpreter component:

  • If you are using OpenAI, the model you use must be gpt-4o or later.

Configure the tuning stage

  1. In the SmartHub Administration portal, click General Settings.

  2. In the User Experience Tuning section, click Add Query Tuning.

  3. In the User Experience Tuning field, select OpenAI Topic Splitter from the drop-down list.

  4. In the Name field, enter a name for your tuning stage.

  5. In the Model Name field, enter the model name for your OpenAI model.

  6. In the API Key, field, provide the API key for your OpenAI resource.

  7. In the Prompt field, define the instructions that guide the AI model on how to split the user's multi-topic input into separate sub-qeuries. For example "Given a natural language customer search input, split it into multiple independent and self-contained search queries suitable for downstream search or retrieval tasks without using verbs".

  8. In the Test Search Query field, enter a sample query to test your tuning stage configuration.

  9. Click Test Request. The tuning stage will send the test search query to the OpenAI model and will populate a response in the Response field.

  10. When you are happy with your test results, click Accept.