Mobile commerce proof of concept app with AR-powered product descriptions
Client
OneMagnify
Partnership
May 2018 - present
Location
United States
Industry
Retail
Technology
Node.js, MongoDB, Amazon Web Services, ARKit, Swift
Services
Product Design, Mobile Development
About project
Our client is an alcohol brand supplier and the retailer came to us with a request to develop native iOS and Android app for brand promotion. The idea was to provide a customer with detailed information about a product using funny and interacting AR tools.
User flow
The main function of the app is the ability to find the drink you're interested in, so we paid a lot of attention to create a smooth search flow. It's easy to get into search & categories from any screen of this app.
AR technology
The idea was to provide a customer with detailed information about a product using funny and interacting AR tools. After fast scanning of a bottle label, an AR animated skull shows up to tell a customer a story about the product.
Spirits cards & categories
Elite contains a huge base of recipes for every taste. The user can choose the spirits they like from categories or search it, and get all the additional information as articles, youtube videos & recipes.
Favorites & news
It's easy to save the spirits & recipes to favorite list, if the user does not want to lose it, and come back to it later. Also, the app has its feed with all the latest news and press releases.
Recipe cards
Every spirit has a bunch of recipe card, that's why the user can easily found out how they can use a favorite drink. Recipes can be filtered by category and contain step-by-step instructions about how to create a wonderful cocktail.
Result
The main technical challenge was to find a proper library for label recognition. All the bottles have different forms, it was crucial to find the tools with an ability to identify labels from different angles with equal accuracy. The other tricky thing was to make an animated character speak: we needed to match skull movements with the soundtrack in a way that the skull had begun to speak. Our partner got an engaging app with the naturally talking skull helping to attract their customers.