Sony Corporation established Sony AI as an internal organization in November 2019 and it became a new company in April 2020 with a global presence in Japan, the United States and Europe. Sony AI promotes fundamental research and development of artificial intelligence (AI) and aims to “create AI that unleashes human imagination and creativity.”
In addition to Sony’s existing business areas of “gaming” and “imaging & sensing,” Sony AI has set “gastronomy” as its flagship theme for new technical and business exploration. With the aim of enhancing the creativity and techniques of chefs around the world, the Gastronomy Flagship Project consists of the research and development of an AI application for new recipe creation, a robotics solution that can assist chefs in their cooking proess, and a community co-creation initiative that will serve as a foundation to these activities.
In addition to Game, Music and Pictures, Sony AI sees great opportunities in Gastronomy as one of the global creative entertainment domains connecting chefs, who are creators, with their audiences. To this end, Sony AI will pursue its own research and development efforts in partnerships with various collaborators.
AI-Powered Recipe Creation App
Recipe creation is a very challenging research area for AI, as there are infinite possiblities for combinations of ingredients, as well as constraints such as location, climate, season, and a person’s health and food preferences, that must be taken into account.
Sony AI will utilize a variety of data sources – including recipes and ingredient data, such as taste, aroma, flavor, molecular structure, nutrients, etc. – to develop a Recipe Creation App that will be powered by proprietary AI algorithms to assist the world’s top level chefs in their creative process of ingredient pairing, recipe design and menu creation.
Through this App, Sony AI aims not only to assist in making delicious food, but also to contribute to people’s health and the sustainability of the environment.
Chef Assisting Cooking Robot
Developing a robotics solution that works in harmony with chefs – to replicate and in some cases even exceed their skills and techniques with high precision and speed – is a great challenge in the realm of AI and Robotics. This is precisely the reason that Sony AI will pursue this grand challenge through the research and development of an advanced and precise Chef Assisting Cooking Robot that can be an ultimate assistant to world-class chefs.
Cooking is a highly complex process that includes such steps as the preparation of ingredients of different shapes and characteristics, the physical transformation of these ingredients using various tools, and the plating of these ingredients into a final dish. Through collaborations with world-class chefs, Sony AI aims to create a solution that can assist chefs through the entire cooking process, from preparation to plating, by training the robots with sensors and AI for skill acquisition.
In addition, remote operations of these robots, for example to serve the chef’s meals to people in remote locations, are also in scope of these research and development efforts.
Community Co-creation Initiative
The creation and execution of new recipes and menus is based on the knowledge, experience and creativity of chefs, and the enjoyment of such creations is built on the health of the gastronomy community, which has been deeply impacted by the pandemic. With the aim to contribute to the long-term sustainability of the community, Sony AI believes it is essential to build and strengthen its relationships with the chef community worldwide, and to work with universities, research institutes and companies that are at the forefront of research in these areas.
Today, Sony AI is pleased to announce the release of the “Chef Interview Series” on its company website as the first step in building such relationships with the culinary community. Sony AI interviewed a total of 18 chefs and food experts via online interviews to learn about their sources of inspiration, the creative process behind their menu creation, their use of technology, their thoughts on sustainability, and other trends that will be essential to the future of gastronomy.
Sony AI will continue to drive dialogue with creators and experts in a wide range of food-related fields, and leverage these learnings in the development of its AI application and robots. https://ai.sony/