| Note |
|---|
Evaluation statistics must meet the thresholds described here. If they do not please first go over the instructions again and ensure that you have correctly implemented the model and training procedure. Then check out our Model Improvement page. To receive full points on your basic intent and slot classifier you must exceed our defined thresholds. See more information on our Assessment Rubric page. |
Objective
In evaluate.py one can see an evaluate function. The evaluation step helps us understand how well the trained model performs on the test dataset. It provides insights into the model's strengths and weaknesses by calculating key metrics for intent classification and slot-filling tasks. These metrics are critical for ensuring the model meets performance expectations.
...