Components Recognition

components contours


After photo was taken from the real dish or image was selected from the gallery, the app opens new page and start in parallel the recognition of dish components and of the whole dish.

The page Components Recogniton consists of two parts:

As the recognition goes on, the app draws new contours of different colors around the recognized components. Simultaneously the app pronounces the name of component: "waffles", "strawberry", "meringue", and adds it to the list.

The slider Confidence Threshold below the image defines how the components will be displayed. If the recognition confidence is below the threshold, the app will draw the contour but will not print the name of component. In our example the confidence < 1%, and all components names will be printed.

components list


Each component in the list is represented by panel that consists of:

Buttons for the components

Speak

Tapping button Speak the user can modify the component by voice. It is need to pronounce in following order : quantity, measurement unit, name.

For example: "one hundred grams of butter".

Or: "three teaspoons of olive oil".

User can pronounce only the part of the component details. For example, he can say "tomato" and the app will replace the name of component. Or user can say "fifty grams" and app will replace old quantity with 50 g.

Edit

Button Edit opens the popup window for Recipe Item Editor


Delete

Button Delete removes selected component from recipe. It becomes displayed in gray color, its name is printed as "not set", the quantity and weight become zero.

recipe_editor


Alternatively to the small button Edit Edit the user can tap inside the contour of the component and the app will show popup window with Recipe Item Editor. In our example user pressed on the strawberry contour. User should inform the app about quantity and measurement unit of the component and tap the button Edit Verify

components list


When component is verfied by the app, it becomes marked by the icon Check.

Buttons for the page

At the bottom of the page there are several floating buttons


Entry

This button opens new page Components Entry where the user can go step by step through the list of the recognized components, and modify them if neeed.

Next

When user completes editing of the recipe components, he taps this button in order to open the Nutrients page and finish adding the meal to the Food Diary

Speak

Tapping button Speak user gives voice commands to the app.


Information

Button Information opens popup window with brief description of the page, its voice commands and buttons.