...
Extension and Exclusions (see Extensions for inspiration) | |||||
|---|---|---|---|---|---|
Criteria | Poor | Average | Good | Excellent | Max Points |
Exclusion Implementation | Exclusion functionality is missing, incomplete, or unable to effectively be used at all. Little collaboration or effort to integrate exclusion approaches is evident. (0) | Exclusion functionality includes basic capabilities such as excluding a single type of slot but lacks refinement. Limited approach or minimal testing and analysis. It was completed with Dialogflow or your own intent and slot classifier. (23) | Exclusion functionality works well for at least 2 slots. Multiple changes in the pipeline are made and combined effectively. Testing and trade-offs are adequately considered. It was completed with Dialogflow or your own intent and slot classifier. (46) | Exclusion is comprehensive and well-integrated, handling multiple slots. Can be combined effectively with inclusion. Approaches are thoughtfully combined and tested rigorously, and limitations are clearly minimized. It was completed with your own intent and slot classifier. (68)6 | 8 |
Extensions to Agent Functionality (Recipe Filtering) | Little to no extensions to improve agent functionality were implemented. Extensions do not significantly enhance user experience or recipe filtering. (0) | Extensions improve functionality but are minimal, lack originality, or are not fully operational. They may replicate basic agent features with minor variations. It was completed with Dialogflow or your own intent and slot classifier. (2) | Extensions improve key aspects such as NLU, filtering, and visual/aural communication. They are moderately complex and enhance user interaction meaningfully. It was completed with Dialogflow or your own intent and slot classifier.(4) | Extensions are innovative, complex, and significantly enhance agent functionality, filtering, and user interaction. They demonstrate originality and are well-implemented. It was completed with Dialogflow or your own intent and slot classifier. (6) | 6 |
Conversational Competence and Navigation (Extension to Dialogue Patterns) | Few or no conversational patterns, repair strategies, or navigational features are added. Added features (e.g., restarting, stopping filters) are non-functional or unclear. (0) | Basic conversational patterns and navigational features (e.g., restarting or stopping filters) are added, but they lack depth, are inconsistently functional, or fail to address misunderstandings effectively. It was completed with Dialogflow or your own intent and slot classifier. (2) | Conversational patterns cover relevant scenarios, and navigational features (e.g., restarting, stopping, removing filters) work reliably. Basic repair strategies and improved conversational flow are present. It was completed with Dialogflow or your own intent and slot classifier.(4) | Conversational patterns and navigational features are well-integrated and intuitive. Patterns handle misunderstandings effectively, and navigation options (e.g., restarting, stopping, removing filters) are user-friendly, enhancing flexibility and user experience. It was completed with Dialogflow or your own intent and slot classifier.(6) | 6 |
Design and User Engagement (Extension to Visual Support) | Little or no effort to improve agent design in terms of visuals, utterances, or conversational style. (0) | Basic design improvements are present but lack originality, cohesion, or a clear target audience focus. Limited to either visuals or utterances. (2) | Agent design is engaging and consistent, with clear visual and conversational improvements tailored to a general audience. (4) | Design is highly engaging, cohesive, and tailored to a specific target audience. Visuals, utterances, and conversational style enhance usability and align with recipe selection goals. (6) | 6 |
Connecting your Pipeline | You have not connected your intent and slot classifier to your MARBEL agent. (0) | You have attempted to connect your intent and slot classifier to your MARBEL agent but it has issues. (21) | You have attempted to connect your intent and slot classifier to your MARBEL agent but it has minor issues. (42) | You have connected your intent and slot classifier to your MARBEL agent and completed your extensions and exclusion features with it. (64)6 | 4 |
Total Points | 30 |