Classifier

Introduction

In the Optimization view in the backstage of Teneo Studio Desktop, the developer will find the Classifier which is the workbench of the solution's Intent Classifier. Here the developer can review inputs coming from live logs and see how these inputs are handled by the intent model.

Retrieve Data

Before getting started and to retrieve data, i.e., inputs:

• Optionally select a Revision Range and / or change the Date Range (also see below section)
• Click Run to query the assigned Log Data Source.

It is recommended to select a Revision Range and / or a Date Range to avoid the Classifier timing out, especially in solutions with a big amount of data.

While a query is running and the inputs loaded, a Cancel button becomes available next to the Run button.
The Reload button allows to reload the LDS and classes data.

Date Range

Use the Date Range selectors to limit the results to a recent timeframe or select a period in the past to query.
The date range is by default pre-populated with a value of 1 week (i.e., 7 days) prior to the possible end date. The end date can either be:

• today (for Log Data Sources with Until date == "Now"), or
• a set day (for Log Data Sources with a set until date).

No end-date is pre-populated.

Views

The Classifier provides three options to review inputs and classes which all present the user of Teneo Studio with different ways of viewing inputs and improving the intent model.

• Review Inputs
  • Detect and fix
  • Assign when uncertain
• Review Classes
  • Improve the balance

When one view is opened, it is possible to change between the views by clicking the field of the view-name to open the dropdown menu and select another view; it is possible to return to the main screen by clicking the blue circled arrow.

Review Inputs

The Review Inputs section contains the following two views:

• Detect and fix: review inputs for which the model found a single candidate class, i.e., the input has been annotation with just one class
• Assign when uncertain: review inputs where the system is uncertain and have found multiple candidate classes for the same input.

Remember, the classification of the inputs displayed here doesn't reflect if a particular input was actually triggered by the mentioned class in the published solution; this is rather a view of how that particular input is performing within the intent model and hence not within the solution as a whole.

Both the Detect and fix and the Assign when uncertain views display the inputs and classes in different groupings and each grouping can be expanded by clicking the small arrow icon next to the group; show or hide all available classes in the solution by clicking the Show/Hide Class List icon next to the filter field.

The available buttons and actions may vary depending on the view as well as the grouping inside the selected view.

When expanding either of the groupings, the user is presented with a list of classes and inputs. The user can by using the available buttons in the right-side of the input, Assign the input to the class or Fix the input by assigning it to another class.

Right-clicking an input displays the user with a context menu with the following options:

• Send to Tryout: allows to send the input to Tryout to see the behavior of the selected input in the solution as a whole
• Mark selected inputs as reviewed: this option allows to tell Teneo Studio that the input has been reviewed but no further actions need to be taken
• Mark as reviewed...
  • Mark as reviewed to here
  • Mark whole section as reviewed
• Assign to...
• Fix - assign to a different class: drag/drop the input to assign it to a different class when the list of classes is open in the right side of the window
• Clear action for selected inputs
• Clear actions...
  • Clear actions in selected sections
  • Clear all actions

When finished performing any actions, the user must click Apply Pending Actions in the lower part of the window for the changes to take effect. Alternatively, click Clear to discard the changes.

Review Classes

Improve the balance displays classes and suggests the user to add inputs as training data examples to achieve classes with a similar amount of training examples.

By selecting a class in the left side of the view, the right-side view populates with a summary of how the intent model classified a specific input; now, to add an input to the displayed class, simply click the green plus icon in the far right side of the view.
Double-clicking the name of a class will open the Class Manager.

The context menu, when right clicking an input, provides the following options:

• Send to Tryout
• Assign to class name
• Clear actions for selected inputs
• Clear actions
  • Clear actions in selected sections
  • Clear all actions

When finished performing any actions, the user must click Apply Pending Actions in the lower part of the window for the changes to take effect. Alternatively, click Clear to discard any changes.