Welcome to the bot evaluation section!
In the 2023: End Report
...
Introduction
...
you will see a section asking how you tested and evaluated your bot. Throughout this course, you should continuously and thoroughly engage in conversations and analyze the functionality of your bot. As you improve it and add things you should perpetually re-test your conversational agent. We recommend that each team member should try and test other sections' parts.
You should use your bot a ton(at least 10 different conversations per person). Test everything to see if it is working i.e. make sure you trigger all possibilities, patterns, pages, filters, intents etc.
Then, analyze no-match conversations in Training. Go to the Training page in Dialogflow and filter conversations at the top left, this video provides a more thorough explanation of how to do this: Use Dialogflow Analytics & Training to Improve Your Chatbot (2021). Due to us using SIC Analytics part does not apply.
Things we think you should keep in mind during testing and should be included in the Testing Section of your End Report:
Capabilities of your bot
what do you think is most important to test in this phase?
Testing
Test set up
An What an example conversation should look like
What did you test and how
mismatch conversation analysis
Evaluation
how did your test go: good and bad( focus on the bad and why it went wrong)
Improvements
how could one fix problems. will you improve it before turn in or is it not feasible?
during use, what kind of extensions do you think could be useful or improve the performance
how could one even further extend
Use your bot a ton(at least 10 different conversations per person) and lets analyze conversations in Training. Test everything to see if it is working i.e. make sure you trigger all possibilitles, patterns, pages, filters, intents etc.
Write a short report about how you did this and then analyze no match conversations in Training (go to Training page in Dialogflow and filter conversations at top left). How in video? Due to us using SIC Analytics part does not apply.Use Dialogflow Analytics & Training to Improve Your Chatbot (2021)
...