Alan Cowen
(Click to enlarge) Facial expressions of emotion transcend geography and culture worldwide, new study shows. Credit:
Whether at a birthday party in Brazil, a funeral in Kenya or protests in Hong Kong, humans all use variations of the same facial expressions in similar social contexts, such as smiles, frowns, grimaces and scowls, a new study from the University of California, Berkeley, shows.

The findings, published today, Dec. 16, in the journal Nature, confirm the universality of human emotional expression across geographic and cultural boundaries at a time when nativism and populism are on the rise around the world.

"This study reveals how remarkably similar people are in different corners of the world in how we express emotion in the face of the most meaningful contexts of our lives," said study co-lead author Dacher Keltner, a UC Berkeley psychology professor.

Researchers at UC Berkeley and Google used machine-learning technology known as a "deep neural network" to analyze facial expressions in some 6 million video clips uploaded to YouTube from people in 144 countries spanning North, Central and South America, Africa, Europe, the Middle East and Asia.

"This is the first worldwide analysis of how facial expressions are used in everyday life, and it shows us that universal human emotional expressions are a lot richer and more complex than many scientists previously assumed," said study lead author Alan Cowen, a researcher at both UC Berkeley and Google who helped develop the deep neural network algorithm and led the study.

Cowen created an online interactive map that demonstrates how the algorithm tracks variations of facial expressions that are associated with 16 emotions.

In addition to promoting cross-cultural empathy, potential applications include helping people who have trouble reading emotions, such as children and adults with autism, to recognize the faces humans commonly make to convey certain feelings.

The typical human face has 43 different muscles that can be activated around the eyes, nose, mouth, jaw, chin and brow to make thousands of different expressions.

First, researchers used Cowen's machine-learning algorithm to log facial expressions shown in 6 million video clips of events and interactions worldwide, such as watching fireworks, dancing joyously or consoling a sobbing child.

They used the algorithm to track instances of 16 facial expressions one tends to associate with amusement, anger, awe, concentration, confusion, contempt, contentment, desire, disappointment, doubt, elation, interest, pain, sadness, surprise and triumph.

Next, they correlated the facial expressions with the contexts and scenarios in which they were made across different world regions and discovered remarkable similarities in how people across geographic and cultural boundaries use facial expressions in different social contexts.

"We found that rich nuances in facial behavior — including subtle expressions we associate with awe, pain, triumph, and 13 other feelings — are used in similar social situations around the world," Cowen said.

For example, Cowen noted, in the video clips, people around the world tended to gaze in awe during fireworks displays, show contentment at weddings, furrow their brows in concentration when performing martial arts, show doubt at protests, pain when lifting weights and triumph at rock concerts and competitive sporting events.

The results showed that people from different cultures share about 70% of the facial expressions used in response to different social and emotional situations.

"This supports Darwin's theory that expressing emotion in our faces is universal among humans," Keltner said. "The physical display of our emotions may define who we are as a species, enhancing our communication and cooperation skills and ensuring our survival."

In addition to Keltner and Cowen, co-authors of the study are Florian Schroff, Brendan Jou, Hartwig Adam and Gautam Prasad, all at Google.
Original Research: Closed access.
"Sixteen facial expressions occur in similar contexts worldwide" by Alan S. Cowen, Dacher Keltner, Florian Schroff, Brendan Jou, Hartwig Adam & Gautam Prasad. Nature

Abstract

Sixteen facial expressions occur in similar contexts worldwide

Understanding the degree to which human facial expressions co-vary with specific social contexts across cultures is central to the theory that emotions enable adaptive responses to important challenges and opportunities. Concrete evidence linking social context to specific facial expressions is sparse and is largely based on survey-based approaches, which are often constrained by language and small sample sizes. Here, by applying machine-learning methods to real-world, dynamic behaviour, we ascertain whether naturalistic social contexts (for example, weddings or sporting competitions) are associated with specific facial expressions across different cultures. In two experiments using deep neural networks, we examined the extent to which 16 types of facial expression occurred systematically in thousands of contexts in 6 million videos from 144 countries. We found that each kind of facial expression had distinct associations with a set of contexts that were 70% preserved across 12 world regions. Consistent with these associations, regions varied in how frequently different facial expressions were produced as a function of which contexts were most salient. Our results reveal fine-grained patterns in human facial expressions that are preserved across the modern world.