Configure the chunk processor component

The Chunk Processor component allows you to specify a pipeline that you want to use to process your chunks. By doing so, you will be able to treat each individual chunk as if it were its own document and apply an entire pipelines functionality to your chunks to further process and enhance them. For example, you could call a pipeline that applies vector embedding to documents through a scripting component, in order to apply vector embeddings to your chunked content. To add the chunk processor component, do the following:

1. In the AutoClassifier admin console, open the pipeline where you added your Document Chunker component.

2. Expand the New Component section.

3. From the component list, select Chunk Processor and enter a name for the component.

4. Click Add.

5. Click on the newly added chunk processor component.

6. In the Configuration section, select a pipeline from the Online Pipeline Name drop-down menu.

7. Click Save.

Once complete, the pipeline that you specified will apply it's functionality to all of the generated chunks.