Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

If you ever baked a cake or cooked a meal from a recipe in a cooking book or on a website opened in your phone/tablet, you probably recognize the hassle of repeatedly checking the details of a step and having to scroll through a screen with hands dirty from cooking. Throughout the Project MAS course, you will be working on the solution to those sorrows: a cooking assistant that conversationally guides the user through a recipe and responds to his/her questions.

...

Recipe Selection

Visual Support

Recipe Instruction

Week -1

  • Enable greeting

  • Enable selection of recipes by name

  • Choose 3 recipe features

  • Display recipe name / image

  • Enable instruction of recipes

  • Enable capability check

  • Enable end of recipe

  • Enable closing the conversation

Week - 2

  • Enable selection of recipes by one feature

  • Enable ingredients check

  • Enable utensil check

  • Display recipe feature

  • Display recipes based on feature

  • Display ingredients for check

  • Display utensils for check

  • Enable switching between recipes

  • Enable conversation repair

Week - 3

  • Enable selection of recipes by multiple features

  • Displays during recipe selection

  • Displays during recipe steps and clarification questions

  • Enable clarification questions

  • Enable user / agent appraisal

Week - 4

  • Think of and implement extensions to the cooking assistant

  • Evaluate cooking assistant

With the new perspective, you might want to consider this flow. Each page has Team Contribution, which explains what I think can be done here by each pair.

Recipe Selection

Visual Support

Recipe Instruction & Clarification

Week -1

  • Extraction Of Features

  • Prepare conversational patterns to extract features values.

Mapping

  • Image Tagging

Creating Dialog flow

  • Greeting the User

  • Add Intents

  • Add entities

  • Modeling Patterns

By here you can enlist a few recipes from knowledge-base, and user is offered to choose between them

Week - 2

Extending Conversations

  • Getting the values of sub-features; like. quantity of ingredients or list of utensils

  •  Feature values to Images

Extending Conversations

  • Checking Ingredients

  • Checking Utensils

  • Switch Recipe - no ideas here yet

Here we have a final recipe selected, and the ingredients and utensils are available.

Week - 3

Slot-filling 

  • Collecting the missing information

 Timer and Step

Clarification:-

  • how to prepare

  • going back and forth

  • how much quantity is desired

Week - 4

Do you want to do more?

 

  • Testing and Evaluation of the Agent

  • Report Submission