Project for Kakao AI to conceptualize an AI service utilizing speech recognition and object recognition technology within the mobile environment.
Role
UX design
UI design
User research
Team
Solo project
Duration
1 week
Concept designs for an ai cooking assistant that finds recipes, gives step by step instructions, saves recipes to the user's cookbook, and calculates unit conversions along with general tasks such as playing music or sending text messages.
Inspiration
Transforming my love for cooking into a practical solution, I identified a common challenge: accessing recipes on my phone with wet, ingredient-filled hands. Navigating unit conversions, timers, and texts became cumbersome. While a voice AI assistant streamlined certain tasks, following recipes on the phone remained a hurdle. This challenge fueled my inspiration to create an AI cooking assistant, addressing the pain points encountered during culinary adventures with friends.
User Testing and Role Play
To assess the practicality of using smart mobile devices while cooking, I conducted a diary study. While preparing a recipe, I observed myself using the phone ten times within 20 minutes for various reasons. These included multiple views of the ingredients list, checking the next steps (despite the phone turning off), unit measurement conversions, and referencing photos in the recipe. This study provided valuable insights into the challenges faced during real-time cooking scenarios.
Current Experience Diagram
Studying Voice AI on Mobile Devices
To understand the personality and functionality of the Kakao voice assistant, I visited the Kakao store. My focus included assessing loading times, answering abilities for general and specific queries, and evaluating its tone and language. During interactions, I discovered limitations, such as Kakao's inability to fulfill a specific recipe request. Additionally, I extensively reviewed various voice assistants, including Google, Siri, Clover by Naver, and KakaoMap on my mobile device, to observe and compare their interactions.
Sketch Ideation
Dialogue Flow of new voice AI Experience
High level call flow
Dialogue diagram (click to zoom)
Explorations
Final Designs
Voice interaction states
Motion prototype
Finding recipes using kakao voice ai
Retrieving recipes and getting recipe directions through kakao voice ai
Next Steps
-
Prototype the above voice interaction with another person or through a voice recording
-
Refine the language to achieve most natural human voice interaction
-
Go through all the possible ways a user might state the command
-
Cover multiple use cases for voice ai interaction while cooking
-
Design for those multiple use cases
-
Further refinement for accessibility
-
Potential consideration for localization to english