Smile Sampler

UX/UI design for automated sampling unit

Smile Sampler render shown in a store candy asile

Overview

Smile Sampler is a sampling unit that automatically dispenses a product sample when a smile is detected with Emotion Recognition Technology.

The goal of this project was to create an automated sample dispensing solution that would draw customers into center-store aisles, and would be easily implemented by grocery and big-box retailers.

Outcome

The Smile Sampler successfully attracts shoppers and users reported they enjoyed the experience and would seek it out again. It brings excitement to center store and creates an opportunity to increase purchases, while also being practical for retailers to implement and support.

Client

The Hershey's Company

Platform

iOS

Timeline

3 months

My Role

I was responsible for the overall user experience design on this project, while working with a cross-functional team.

The team was made up of eight individuals, including: a creative director, an architectural designer, a visual designer, a software developer, an industrial engineer, an account executive, an account strategist, and myself, as a senior interaction designer.

Responsibilities

  • User Experience Design
  • User Interface Design
  • User Testing
  • Initial Visual Design

Problem

Physical retail sales are in decline, particularly in the center-store grocery area. Many consumers consider the center-store uninteresting and unappealing.

25%
of Millennials say that the center store is a boring part of the store
23%
of Millennials say 'I almost get claustrophobic when shopping center store'
~75%
of shoppers never even venture down the certain center-store aisle such as the confection aisle

Process

Cross-functional projects with a large array of moving parts, like this one, take a great deal of coordination and collaboration. Ideating, iterating, and working as a team was critical to this project’s success.

Process Diagram

Discover

In order to create an informed user experience, I utilized information provided to me by co-workers with access to subject matter experts who understand consumer packaged goods brands that sell in the center-store aisles, as well as the pain points of retailers.

Shared Insights

In 2013, a CPG Qualitative Aisle Reinvention research revealed:

A womean who is smiling and happy in a store
People like samples
A women who is walking down a store aisle
People are more likely to go down an asile that has sampling available
a hand holding a shopping basket in a store
When they go down the aisles, they’re more likely to make a purchase

Retailer Considerations

It was important to create a solution that could meet the project goals and also be easy to implement. Appealing to retailers was a carefully considered aspect of the project.

Retailer considerations:
  • Size: Unit should fit into existing gondola and store aisle
  • Internet access: Most stores don’t have access from the center-store
  • Power Supply: Supplying power to the center store may be difficult
  • Cost: Installation, maintenance, and replenishment should be kept to a minimum

Ideate

Once the team had a thorough understanding of project goals, we began to closely collaborate and develop a solution.

Engineering/ Architectural Design

The architectural designer and industrial engineer lead the design process of the physical manifestation and functionality of the dispensing unit. I worked with them to ensure the user's needs were taken into consideration.

Engineering and architectural design considerations:
  • Camera Position: Allow the camera to be adjusted for users of different heights
  • Accessibility: Make a clear and easy path to the camera to meet ADA requirements
  • Waste: Include a trash receptacle

Smile Sampler Architectural Design Render

  • Smile Sampler Architectural Design Render Face On View
  • Smile Sampler Architectural Design Render Angle View
  • Smile Sampler Architectural Design Render Side View

Sketch & Wireframe

Taking technical and cost requirements into account, the team chose to use iPads for the touch screens and cameras. Working from the touch screen dimensions, I sketched out the user interface. When my sketches were approved by the team, I digitized them into wireframes.

Smile Sampler paper sketches

Photo: Smile Sampler paper sketches

Smile Sampler Wireframe

Smile Sampler wireframe - zoom in

User Interface & Visual Design

When my wireframes were finished, I mocked-up the interface with a visual design that would also be applied to the physical build.

Smile Sampler User Interface & Visual Design

  • Visual Design of Physical Build & User Interface Overview
    Visual Design of Physical Build & User Interface Overview
    Visual Design of Physical Build & User Interface Overview - Zoom In

    Visual Design of Physical Build & User Interface Overview

  • Step 1: Home Screen
    Step 1: Home Screen
    Step 1: Home Screen - Zoom In

    Step 1: Home Screen

  • Step 2: Camera Turns On
    Step 2: Camera Turns On
    Step 2: Camera Turns On - Zoom In

    Step 2: Camera Turns On

  • Step 3: Face Detection
    Step 3: Face Detection
    Step 3: Face Detection - Zoom In

    Step 3: Face Detection

  • Step 4: Smile Detection
    Step 4: Smile Detection
    Step 4: Smile Detection - Zoom In

    Step 4: Smile Detection

  • Step 5: Photo Taken
    Step 5: Photo Taken
    Step 5: Photo Taken - Zoom In

    Step 5: Photo Taken

  • Step 6: Sample Dispenses
    Step 6: Sample Dispenses
    Step 6: Sample Dispenses - Zoom In

    Step 6: Sample Dispenses

Users standing in front of the Smile Sampler prototype unit

Prototype, Test & Iterate

When the design of each respective part of the project was completed, the unit was built, and we began to test and iterate.

Users touching the Smile Sampler prototype touch screen
Users smiling at the Smile Sampler prototype to get a sample

Photos: Users testing the Smile Sampler prototype

The Account Strategist coordinated and recruited research participants for usability testing. I conducted the test and collected data on the Smile Sampler’s performance.

Overall the unit performed well and reactions were positive. We identified a few areas in which improvements could be made.

We decided to add additional visual cues to better indicate to users that the interface is measuring their smile, and that they need a big smile to get a sample.

We found that the dispensing unit could easily jam, and decided on changes to mechanical design in future iterations.

Design

When the testing and validation phase was completed, a visual designer applied the Hershey's branding to the Smile Sampler user interface and physical build.

Visual Design with Hershey's Branding

Hershey's Smile Sampler

  • Smile Sampler with Hershey's Branding
    Smile Sampler with Hershey's Branding
    Smile Sampler with Hershey's Branding - Zoom In

    Smile Sampler with Hershey's Branding

  • Hershey's Smile Sampler UI: Home, Terms & Conditions Screens
    Hershey's Smile Sampler UI: Home, Terms & Conditions Screens
    Hershey's Smile Sampler UI: Home, Terms & Conditions Screens - Zoom In

    Hershey's Smile Sampler UI: Home, Terms & Conditions Screens

  • Hershey's Smile Sampler UI: Face Detection Screens
    Hershey's Smile Sampler UI: Face Detection Screens
    Hershey's Smile Sampler UI: Face Detection Screens - Zoom In

    Hershey's Smile Sampler UI: Face Detection Screens

  • Hershey's Smile Sampler UI: Smile Detection Screens
    Hershey's Smile Sampler UI: Smile Detection Screens
    Hershey's Smile Sampler UI: Smile Detection Screens - Zoom In

    Hershey's Smile Sampler UI: Smile Detection Screens

  • Hershey's Smile Sampler UI: Publicly Share Image Permission Screen
    Hershey's Smile Sampler UI: Publicly Share Image Permission Screen
    Hershey's Smile Sampler UI: Publicly Share Image Permission Screen - Zoom In

    Hershey's Smile Sampler UI: Publicly Share Image Permission Screen

  • Hershey's Smile Sampler UI: Sample Despencing Screens
    Hershey's Smile Sampler UI: Sample Despencing Screens
    Hershey's Smile Sampler UI: Sample Despencing Screens

    Hershey's Smile Sampler UI: Sample Despencing Screens

Solution

The Smile Sampler grabs the attention of busy shoppers and helps drive them to the center-store. This can help increase in-aisle traffic, drive incremental conversion, increase basket size, build emotional equity, and enrich the retail experience.

Front view of Hershey's Smile Sampler in a aisle

Hardware Features

  • The Smile Sampler can be deployed in-aisle within a 4’ gondola section, used as an endcap, or as a free-standing unit.
  • Sampled product is merchandised in the area surrounding the sampling interface, allowing for easy conversion and follow-through
Close up, side view of Hershey's Smile Sampler in a aisle

Software Features

  • The Smile Sampler invites shoppers to smile into an iPad UI and receive a free product sample in return
  • The Smile Sampler users proprietary face-recognition software to recognize a smile
  • Sample dispensing is limited to once every 24 hours per visitor by facial recognition — a foolproof security measure masked by a playful interaction
Shopper in front of Smile Sampler
1.
Shoppers approach the Smile Sampler, placed at an end cap or mid-aisle
Smile Sampler showing shopper in the camera
2.
Emotion analysis session is prompted and initiated
Smile Sampler showing shopper is smiling
3.
Camera quickly reads entire face, capturing data to be processed by Emotion Recognition Technology
Shopper reaching for sample dispensed by Smile Sampler
4.
Smile Sampler dispenses a single sample when a smiling face is detected
Smile Sampler showing shopper message to come back tomorrow, limit one per day
5.
Facial map details are retained for pre-programmed length or time to limit sample dispensing to once a day
Shopper smiling with sample from Smile Sampler
6.
Level of engagement can now be quantified based on qualitative input

Conclusion

The Smile Sampler was implemented into The Hershey Company's Global Customer Insights Center. It was tested in their flagship store, Hershey's Chocolate World, in Hershey, PA with plans to test it in other retail stores.

Results

The Smile Sampler managed to gain some spotlight. You can read about it by clicking on the following links: AdAge , Confectionery News , Progressive Grocer

The Smile Sampler successfully attracts shoppers and users reported they enjoyed the experience and would seek it out again. It brings excitement to center store and creates an opportunity to increase purchases, while also being practical for retailers to implement and support.

Frank Jimenez

“We think for the confectionery category there is somethin very nostalgic and fun about it. This is a potential way to bring excitment to centere store, every time someone comes to the store it's a draw down the candy aisle and there's a convergence opportunity in it.”
— Frank Jimenez, Senior Director of Retail Evolution

Project Insights

  • Simplicity is strength
    Designers are often drawn to aesthetically pleasing and trendy out-of-the-box designs. However, pragmatism is a virtue when looking for an appropriate solution to a problem.
  • Teamwork is critical
    Solving complex problems becomes simpler through collaboration