Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

If you ever baked a cake or cooked a meal from a recipe in a cooking book or on a website opened in your phone/tablet, you probably recognize the hassle of repeatedly checking the details of a step and having to scroll through a screen with hands dirty from cooking. Throughout the Project MAS course, you will be working on the solution to those sorrows: a cooking assistant that conversationally guides the user through a recipe and responds to his/her questions.

...

Once you know how to get started, your main focus is to design and develop a prototype of a Cooking Assistant using the GOAL Agent Programming. You can be as creative as you want, but do not forget to document your code and project.

This assignment requires good communication and contribution throughout the assignment. As per the distribution of work, a group of six will work in three pairs. Thus, the pair working on Recipe Selection (RS) will mainly work on selecting the recipe, while Recipe Instruction (RI) will work on instructions related to the conversational agent design. The Visual Support (VS) team will focus on providing support to the two regarding the related images. Below is a weekly distribution of the MAS project assignment. Click on the week number to get more details related to ‘To-Do’ tasks.

Recipe Selection

Visual Support

Recipe Instruction

Week -1

  • Enable greeting

  • Enable selection of recipes by name

  • Choose 3 recipe features

  • Display recipe name / image

  • Enable instruction of recipes

  • Enable capability check

  • Enable end of recipe

  • Enable closing the conversation

Week - 2

  • Enable selection of recipes by one feature

  • Enable ingredients check

  • Enable utensil check

  • Display recipe feature

  • Display recipes based on feature

  • Display ingredients for check

  • Display utensils for check

  • Enable switching between recipes

  • Enable conversation repair

Week - 3

  • Enable selection of recipes by multiple features

  • Displays during recipe selection

  • Displays during recipe steps and clarification questions

  • Enable clarification questions

  • Enable user / agent appraisal

Week - 4

  • Think of and implement extensions to the cooking assistant

  • Evaluate cooking assistant

With the new perspective, you might want to consider this flow. Each page has Team Contribution, which explains what I think can be done here by each pair.

Recipe Selection

Visual Support

Recipe Instruction & Clarification

Week -1

  • Extraction Of Features

  • Prepare conversational patterns to extract features values.

Mapping

  • Image Tagging

Creating Dialog flow

  • Greeting the User

  • Add Intents

  • Add entities

  • Modeling Patterns

By here you can enlist a few recipes from knowledge-base, and user is offered to choose between them

Week - 2

Extending Conversations

  • Getting the values of sub-features; like. quantity of ingredients or list of utensils

  •  Feature values to Images

Extending Conversations

  • Checking Ingredients

  • Checking Utensils

  • Switch Recipe - no ideas here yet

Here we have a final recipe selected, and the ingredients and utensils are available.

Week - 3

Slot-filling 

  • Collecting the missing information

 Timer and Step

Clarification:-

  • how to prepare

  • going back and forth

  • how much quantity is desired

Week - 4

Do you want to do more?

 

  • Testing and Evaluation of the Agent

  • Report Submission