🔥 Try out our Discovery Workshop! Crystalize your idea in the shortest time possible

Learn more
Case study

Mobile commerce proof of concept app with AR-powered product descriptions

Client

OneMagnify

Partnership

May 2018 — present

Location

United States

Industry

Retail

Technology

Node.js, MongoDB, Amazon Web Services, ARKit, Swift

Services

Product Design, Mobile Development

About project

Our client is an alcohol brand supplier and the retailer came to us with a request to develop native iOS and Android app for brand promotion. The idea was to provide a customer with detailed information about a product using funny and interacting AR tools.

User flow

The main function of the app is the ability to find the drink you're interested in, so we paid a lot of attention to create a smooth search flow. It's easy to get into search & categories from any screen of this app.

AR technology

The idea was to provide a customer with detailed information about a product using funny and interacting AR tools. After fast scanning of a bottle label, an AR animated skull shows up to tell a customer a story about the product.

Spirits cards & categories

Elite contains a huge base of recipes for every taste. The user can choose the spirits they like from categories or search it, and get all the additional information as articles, youtube videos & recipes.

Favorites & news

It's easy to save the spirits & recipes to favorite list, if the user does not want to lose it, and come back to it later. Also, the app has its feed with all the latest news and press releases.

Recipe cards

Every spirit has a bunch of recipe card, that's why the user can easily found out how they can use a favorite drink. Recipes can be filtered by category and contain step-by-step instructions about how to create a wonderful cocktail.

Result

The main technical challenge was to find a proper library for label recognition. All the bottles have different forms, it was crucial to find the tools with an ability to identify labels from different angles with equal accuracy. The other tricky thing was to make an animated character speak: we needed to match skull movements with the soundtrack in a way that the skull had begun to speak. Our partner got an engaging app with the naturally talking skull helping to attract their customers.