Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

In this section, you should explain the testing and data gathered that was described in User Study. You should very briefly include the test setup, your goals, and then explain and analyze the data, and discuss lessons learned from your small user study. In the analysis, discuss the performance of some of your extensions separately. To what extent did they improve the interaction with your agent?

For the analysis, looking at quantitative measures found in the logs ca provide valuable insights. Examples of information that can be extracted from the logs and used for analysis include (but are not limited to):

  • Number of utterances/intents per interaction

  • Variety in intents and entities (are there unused intents?)

  • Confidence values for the intent classification (are there any patterns of specific intents having low/high confidence values)?

  • Interaction length (in time)

Conclusion: (max. 1 page):

...