Machine Learning Training Data

Training data can be used with Machine Learning to create and train Machine Learning Classification Algorithms. 

  • Training data uses publicly available data from NCBI (National Center for Biotechnology)

  • Available data sets:

    • PubMed
    • PMC

To use training data:

  1. In the AutoClassifier administration portal, click Machine Learning Providers.
  2. Open an existing or create a new Machine Learning Provider.
  3. Expand the Available Training Data section.
  4. Select an available Training Set.
  5. Configure the Available Training Data options:
    1.  APIKey (Optional): NCBI provides the ability to register for an API Key which enables greater concurrent requests when retrieving data. The current code throttles to the allowable limit of 3 concurrent requests per min.
    2. Train Leaf Nodes Only: When retrieving training data, the option is available to train all nodes in the Taxonomy Tree or just the leaf nodes (The lowest node).  To train only leaf nodes and not the whole hierarchy, select this option.
    3. # Documents Per Node:  Specify the number of Documents to use per Node when training. The more documents used typically provides more accurate results but requires longer training time.
    4. # Nodes to Train:  Specify a number of nodes to attach training data to when testing. For example, If only Train Leaf Nodes is selected and "20 Nodes to Train" is selected, then only the first 20 Leaf Nodes will have training documents attached
    5. Select a Creation/Training Option:
      1. Create and Train Taxonomy: Create both a new taxonomy and train the nodes per the configuration options
      2. Create Taxonomy Only: Will create a new taxonomy but not train any nodes
      3. Training Existing Taxonomy: If a Taxonomy already exists the process will train the taxonomy
    6. Nodes to Create: Specify a number to limit the number of taxonomy nodes to create when testing.
      1. Hit Load Training Data: Depending on the options this can be a time-consuming process. When completed, a taxonomy will be available with training data, depending on configuration, and attached to the Machine Learning Provider.
    7. Select Taxonomies to Create: Select the taxonomies that you want to create for the specified provider.