...

[TBU]Filtering by Inclusion

6. Connecting Your Entire Pipeline

Connect MARBEL with Intent/SLot Classifier and WHISPER remove Dialogflow.

7. Unexpected Intents

Summary Description

A conversational agent should be able to handle dialog moves of users that do not necessarily fit into the currently active pattern. Such moves are “unexpected” in the sense that they do not fit into a conversational pattern, but should be expected as users will almost always slightly deviate from a rigidly framed pattern. Typical examples are expressions of appreciation and requests for information about how the agent can assist a user (a capability check). A second type of unexpected move is not due to user behavior but due to failures of speech recognition. Dialogflow will match with a so-called default fallback intent in cases where it is unable to recognize what a user says as and cannot classify it as one of the (other) intents of the agent. There is another case that we will look into too where what a user says does not seem to fit into the conversational context. Again, we can capture the “unexpected” in patterns, which will enable the conversational agent to handle them:

...

Implementation Tasks Overview

Instructions

Filter Recipes by Ingredients and Cuisine

Implementing this capability will involve implementing some of the conversational and reasoning competences that a conversational recipe recommendation agent should have. It will enable users to request recipes which use specific ingredient (types) or ask for recipes from a specific cuisine. This one of the capabilities that requires quite a big amount of work. Some of the bigger challenges will be to make Dialogflow understand ingredients (at least those that are in our database; and cuisines, for that matter, but those are fewer), to implement the logic to filter the recipe database with the feature requests of a user, and to present those in a nice way to the user on a webpage.

Summary Description

A: What recipe would you like to cook?

U: I'd like to make a recipe with ____ *.

A: All the recipes left include ____ *. Do you want to add another preference?

• insert name of an ingredient (type) or cuisine here

Implementation Tasks Overview

Instructions

Filter Recipes by Dietary Restrictions

Summary Description

We continue to extend the capabilities of the agent to handle user requests. The focus will be to enable a user to ask for recipes that meet dietary restrictions. This will also involve extending the logic of reasoning about ingredients. The main challenge will be to come up with an efficient approach to define this logic.

A: What recipe would you like to cook?

U: I'd like to make a ____ * recipe.

A: Here is a list of recipes that fit your preferences.

• insert a recipe feature such as vegan, for example, here

Implementation Tasks Overview

Instructions

Filter Recipes by Excluding Features

Summary Description

The last extension to increase the capabilities of our agent will look into feature requests that exclude aspects of a recipe. There are many examples of this, but we will focus on user requests that ask for excluding an ingredient (type), for recipes that are not from a particular cuisine (e.g., not from Asia), or do not have a specific dietary restriction (e.g., are not vegan). You are, of course, invited to extend the agent with other similar capabilities to exclude aspects of a recipe.

A: What recipe would you like to cook?

U: I want a recipe without ____ *.

A: Here is a list of recipes that fit your preferences.

• insert an ingredient such as salt here

Implementation Tasks Overview

Instructions

Confirm the Chosen Recipe

Instructions

Unexpected Intents

8. Confirm the Chosen Recipe

Summary Description

When users have finished their search for a nice recipe to cook, their choice should be displayed (which we already implemented for https://socialrobotics.atlassian.net/wiki/pages/createpage.action?spaceKey=PM2&title=2025%20Capability%205%3A%20Filter%20Recipes%20by%20Ingredients%20and%20Cuisinealready implemented for [TBU]Filtering by Inclusion ) and they should be asked to check the details to confirm the recipe is indeed what they would like to cook. Of course, we need to take at least two scenarios into account: (1) a user confirms they are happy with the recipe, or (2) they indicate it is after all not quite what they were looking for. If all is fine and well, the agent should close the conversation by saying farewell. Otherwise, the conversation should move back to the recipe selection stage. The following conversational pattern needs to be implemented:

Implementation Tasks Overview

Instructions

Instructions

9. Removing Filters and Showing Recipes on Demand

Summary Description

The last capability on our list before we ask you to extend the capabilities of the conversational agent using your own insights and ideas is about allowing users to remove requests they made before and to allow them to indicate that they are done providing their preferences. You should implement the following patterns:

...

A: OK. Here is a list of recipes that you can choose from. [Alternative: Sorry, there are still too many recipes left to show them all. Please add more preferences.]

Implementation Tasks Overview

Instructions

Extend Your Agent (Make it Nicer)

Summary Description

Extend your agent even further; look at the

page or talk to your TA for inspiration!

Implementation Tasks Overview

...