Artificial intelligence server

[0000]
Disclosed is an artificial intelligence server. The artificial intelligence server includes a communication unit in communication with an electronic device, a memory for storing data, and a processor configured to receive an image of ingredients from the electronic device, provide the image of the ingredients to an artificial intelligence model to obtain a food name corresponding to the image of the ingredients, and transmit a recipe corresponding to the food name to the electronic device.

[00000]

1. An artificial intelligence server comprising:

a communicator in communication with an electronic device;

a memory for storing data; and

a processor configured to:

receive an ingredient image from the electronic device;

provide the ingredient image to an artificial intelligence model to obtain a food name corresponding to the ingredient image; and

transmit a recipe corresponding to the food name to the electronic device,

wherein the communicator is in communication with a plurality of electronic devices,

wherein the artificial intelligence model is a neural network trained using images of ingredients and food names of final foods produced using the ingredients received from the plurality of electronic devices, and

wherein the processor is configured to:

receive an image of first ingredients and a first final food product image produced using the first ingredients from a first electronic device among the plurality of electronic devices;

obtain a first food name of a food produced using the first ingredients, using the first final food product image; and

label the first food name on the image of the first ingredients to train the artificial intelligence model.

2. The artificial intelligence server of
claim 1
, wherein the processor is configured to:

provide the ingredient image to the artificial intelligence model to obtain a plurality of food names; and

transmit a plurality of recipes corresponding to the plurality of food names to the electronic device.

3. The artificial intelligence server of
claim 2
, wherein the artificial intelligence model includes a plurality of artificial intelligence models respectively corresponding to a plurality of food categories,

wherein the processor is configured to:

provide the ingredient image to the artificial intelligence model to obtain the plurality of food names; and

transmit the plurality of recipes corresponding to the plurality of food names to the electronic device.

4. The artificial intelligence server of
claim 1
, wherein the artificial intelligence model includes a plurality of artificial intelligence models respectively corresponding to a plurality of food categories,

wherein the processor is configured to:

receive food category information together with the ingredient image;

provide the ingredient image to an artificial intelligence model corresponding to the food category information to obtain at least one recipe corresponding to the food category information; and

transmit the at least one recipe corresponding to the food category information to the electronic device.

5. The artificial intelligence server of
claim 1
, wherein the processor is configured to select a recipe to be transmitted to the electronic device among a plurality of recipes corresponding to the food name based on at least one of a popularity or a number of registrations of a recipe corresponding to the food name of each user.

6. The artificial intelligence server of
claim 1
, wherein the processor is configured to:

select a recipe to be transmitted to the electronic device among a plurality of recipes corresponding to the food name based on a type of a cooking device by which the ingredients are to be cooked; or

select a recipe to be transmitted to the electronic device among the plurality of recipes corresponding to the food name based on the type of the cooking device by which the ingredients are to be cooked and model information of the cooking device.

7. The artificial intelligence server of
claim 1
, wherein the recipe includes at least one of control information of a cooking device or a cooking scheme input by a user.

8. The artificial intelligence server of
claim 7
, wherein the processor is configured to:

transmit a final food product image produced by the recipe together with the recipe; and

when a recipe change request is received from the electronic device, transmit a recipe different from the transmitted recipe.

9. The artificial intelligence server of
claim 8
, wherein the processor is configured to:

when a recipe change condition is received together with the recipe change request, transmit another recipe corresponding to the recipe change condition to the electronic device.

10. The artificial intelligence server of
claim 1
, wherein the processor is configured to:

receive, from a cooking device by which the ingredients are cooked, an image of the ingredients being cooked; and

transmit an operation stop command when the image of the ingredients being cooked corresponds to a final food product image produced by the recipe.

11. The artificial intelligence server of
claim 1
,

wherein the processor is configured to receive ingredient images, recipes, and final food product images produced by the recipes from the plurality of electronic devices and store the received ingredient images, recipes, and final food product images in the memory.

12. The artificial intelligence server of
claim 1
, wherein the artificial intelligence model includes a plurality of artificial intelligence models respectively corresponding to a plurality of food categories,

wherein the processor labels the first food name on the image of the first ingredients to train an artificial intelligence model corresponding to a food category to which the first food name belongs.

13. The artificial intelligence server of
claim 11
, wherein the processor is configured to receive at least one of a type or a model name of a cooking device from the plurality of electronic devices and store the received at least one of the type or the model name of the cooking device in the memory.

CROSS-REFERENCE TO RELATED APPLICATIONS
[0001]
This application claims priority to Korean Patent Application No. 10-2019-0100589 filed on Aug. 16, 2019 in Korea, the entire contents of which is hereby incorporated by reference in its entirety.

BACKGROUND
[0002]
The present invention relates to an artificial intelligence cooking device that may receive an image of ingredients from a user, search for recipes of other users using the image of the ingredients, and provide a recipe for a food the user wants to make.

[0003]
Artificial intelligence, which means that computers may imitate a human intelligence, is a field of computer engineering and information technology that studies a method for allowing the computers to think, learn, self-develop, and the like that may be performed by the human intelligence.

[0004]
Further, the artificial intelligence does not exist by itself, but directly or indirectly related to other fields of the computer science. Particularly in the modern age, attempts to introduce artificial intelligence elements in various fields of the information technology and to utilize the artificial intelligence elements in solving problems in the field are being actively carried out.

[0005]
In an example, a technology that uses the artificial intelligence to recognize and learn an ambient situation, provides information desired by a user in a desired form, or performs an operation or a function desired by the user is being actively researched.

[0006]
Further, an electronic device providing such various operations and functions may be referred to as an artificial intelligence device.

[0007]
In an example, recently, people sharing recipes via Internet, social network services/sites (SNS), or the like and cooking using the shared recipes are increasing.

[0008]
However, because of complicate processes of creating and uploading recipes and searching and downloading recipes that are suitable for oneself, sharing recipes and utilizing the shared recipes are currently limited.

SUMMARY
[0009]
The present invention is to solve the above problem. A purpose of the present invention is to provide an artificial intelligence cooking device that may receive an image of ingredients from a user, search for recipes of other users using the image of the ingredients, and provide a recipe for a food the user wants to make.

[0010]
In an aspect of the present invention, there is provided an artificial intelligence server including a communication unit in communication with an electronic device, a memory for storing data, and a processor configured to receive an image of ingredients from the electronic device, provide the image of the ingredients to an artificial intelligence model to obtain a food name corresponding to the image of the ingredients, and transmit a recipe corresponding to the food name to the electronic device.

[0011]
According to the present invention, recipes actually used by customers may be stored as big data on a server and customized recipes may be provided to customers who need recipes.

[0012]
Further, according to the present invention, when a user provides only the image of the ingredients to the artificial intelligence server, the user may be provided with a customized recipe. Especially when the electronic device is an artificial intelligence cooking device, the user may be provided with a customized recipe merely by injecting ingredients into a cooking chamber.

[0013]
Further, according to the present invention, since the food name is predicted using the artificial intelligence model trained based on the big data, a food the user wants to produce using the ingredients may be predicted exactly.

[0014]
Further, according to the present invention, since a recipe is recommended based on a type, model, and a specification of the cooking device, a recipe the most suitable for the cooking device used by the user may be recommended.

[0015]
Further, according to the present invention, since whether a food is finished is determined by comparing an image of the food being cooked with a final food product image, the food may be finished while correcting a difference between a cooking environment of the recipe and an actual cooking environment.

BRIEF DESCRIPTION OF THE DRAWINGS
[0016]
FIG. 1 illustrates an AI device 100 according to an embodiment of the present invention.

[0017]
FIG. 2 illustrates an AI server 200 according to an embodiment of the present invention.

[0018]
FIG. 3 illustrates an AI system 1 according to an embodiment of the present invention.

[0019]
FIGS. 4 to 6 illustrate a cooking device according to an embodiment of the present invention.

[0020]
FIG. 7 illustrates a recipe sharing system according to an embodiment of the present invention.

[0021]
FIG. 8 is a diagram for illustrating a remote control system according to an embodiment of the present invention.

[0022]
FIGS. 9 to 10 illustrate a method for obtaining an image of ingredients, a recipe, and other additional information from a plurality of electronic devices according to an embodiment of the present invention.

[0023]
FIG. 11 is a diagram for illustrating a database according to an embodiment of the present invention.

[0024]
FIG. 12 is a diagram for illustrating a method for training an artificial intelligence model according to an embodiment of the present invention.

[0025]
FIG. 13 is a diagram for illustrating a method for training artificial intelligence models classified based on various food categories, according to an embodiment of the present invention.

[0026]
FIGS. 14 to 15 are diagrams for illustrating a method for obtaining a food name using an image of ingredients, according to an embodiment of the present invention.

[0027]
FIG. 16 illustrates a method for providing recipes of foods belonging to various food categories to a user, according to an embodiment of the present invention.

[0028]
FIG. 17 illustrates a recipe displayed on a first electronic device 1400 according to an embodiment of the present invention.

[0029]
FIG. 18 illustrates a recipe change condition.

[0030]
FIG. 19 illustrates a method for transmitting an operation stop command when cooking is finished according to an embodiment of the present invention.

[0031]
FIG. 20 is a diagram for illustrating an operation when an artificial intelligence model is mounted on a first artificial intelligence cooking device, according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0032]
Hereinafter, embodiments of the present invention are described in more detail with reference to accompanying drawings and regardless of the drawings symbols, same or similar components are assigned with the same reference numerals and thus overlapping descriptions for those are omitted. The suffixes “module” and “unit” for components used in the description below are assigned or mixed in consideration of easiness in writing the specification and do not have distinctive me…