Non-verbal Communication

Emotion

Text-based Computer-mediated Communication

                                                                                  -- MS2 Final Poroject

As providing us easier and faster ways to communicate/connect with others, technology, at the same time, create an environment that people are increasingly using text-based communication where our non-verbal communication are limited than before. I am interested in exploring ways to facilitate people's emotion expression using non-verbal communication when people are using text-based computer mediated communication.

Interests: paralinguistic, non-verbal communication, emotion, text-animation. 

5 in 5 (research)

Day 1: 

What is non-verbal communication? Research on different types of non-verbal communications that people commonly use. Are they more effective than word or not? If they are, in what ways? Can a new non-verbal communication form? Narrow this topic down to a smaller scale. 

"Nonverbal communication (NVC) is the nonlinguistic transmission of information through visual, auditory, tactile, and kinesthetic (physical) channels."

“When team communication relies on electronic media, and is therefore primarily text-based, non-verbal cues are limited, which rises the question of whether mimicking and contagion can occur.“

”Modern teamwork relies on text-based communication.“

“Social interactions are drastically different when they rely on electronic rather than face-to-face communication.”

"Studies have shown that the interplay between technology and social interaction can be adaptive, so that groups whose communication is electronically mediated are marked by greater participation and more extreme, original and risky decisions."

“Daft and Lengel’s analysis of “media richness” identifies text-based communication as a “poor” form of communication, meaning that nuances conveyed through text-based communication can easily be misinterpreted or misunderstood。“

“Emotions could be detected in email, but that different readers interpreted the same texts as expressing different emotions. ”

“Senders have control over text based communications such as capital letters, emotions, or message length. ”

“Face-to-face communication expressions of emotion tend to be automatic, spontaneous, and hard to control, and are therefore presumes to be authentic.

“People tend to attribute sinister intentions to partners in negotiations using electronic media. 

“The resoluteness or flexibility of behavior is a useful sign that can be readily identified even in text-based communication, and even in the absence of direct verbal communication of emotion.”

“Reactions were most negative where a positive verbal message was delivered with a negative facial expression.”

“UCLA research has shown that only 7% of communication is based on the actual words we say. As for the rest, 38% comes from tone of voice and the remaining 55% comes from body language. Learning how to become aware of and to interpret that 55% can give you a leg up with other people.”

"Given the absence of facial and non‐verbal cues, the mainstream computer‐mediated communication literature has, quite rightly, stressed the emphasis placed upon text as the vehicle through which relational work is undertaken (Daft and Lengel, 1986; van Dijk, 1999; Byron, 2008). "

Takeaways: 

Narrowed down my scope to text-based computer mediated communication and non-verbal communication. How to facilitate emotion exchange via text-based communication?

Precedents:

Emoji, iMessage effect (slam, loud, gentle, invisible ink....), animated text....

Day 2:

Research on how emotion, privacy relate to wearables. Should fashion be expressive or not? To what degree?

Emotion vs. Wearables Precedents:

Bubelle Emotion Sensing Dress by Phillip Design

https://crunchwear.com/bubelle-emotion-sensing-dress/

"Philips Design believes our future garments will or should be more ‘Sensitive’ rather than ‘intelligent’."

"The Bubelle Dress changes the look instantaneously according to our emotional state and our personality. "

There are many precedents of garments or accessories that reflect wearer's data such as heartbeats, emotion, motion tracking...But there is little discussion between privacy vs. wearables. 

Day3:

How does this project critically engage with the world? What will it bring to us to think about?

 

As mentioned in the research, nowadays, social media applications have made us focused more on text-based communication. In fact, text-based communication can not convey as much information as people do in face-to-face communication, such as facial expression, tone... As a result, people cannot gain enough information they used to obtain from face-to-face communication, which could led to the misunderstanding of others in a virtue communication space. 

This project is seeking a way to facilitate emotion exchange, in terms of non-verbal communication, when people use text-based communication.

Day4:

My own point of view on expressing emotions to others? Or advocate for the awareness for a possible situation in future? 

For my previous idea that combines emotion expressing and wearables, it is true that, in terms of privacy, enforcing people to show their emotion by their personal data would be used to exploit people.

For text-based communication, I think it is necessary to express emotion where we do in face-to-face communication. Nowadays, people's communication in a virtue space -- internet has somehow reduced communication process from an integration of content, emotion, attitude, etc. to a way that is more focused on content. Therefore, this project can be a way to facilitate the quality of text-based communication by understanding others emotion more. 

Day5:

Final form of this project. Decision on interactions and technology that would be used. 

Form: web-based application

Elements I've been thinking:

input: voice, face recognition, information from user entering a text (speed, time for each word...)

output: animated text representing emotion (size, color, animation)

Ways to achieve: 

Javascript + API (face recognition + text-animation)

Source:

Organizational Behavior and Human Decision Processes

https://www-sciencedirect-com.libproxy.newschool.edu/search/advanced?docId=10.1016/j.obhdp.2011.06.002

Body Language

https://www.scienceofpeople.com/body-language/

Emotions and the spatialization of social relations in text-based computer-mediated communication

https://onlinelibrary-wiley-com.libproxy.newschool.edu/doi/full/10.1111/ntwe.12012

Bubelle Emotion Sensing Dress by Phillip Design

https://crunchwear.com/bubelle-emotion-sensing-dress/

Feedback from 4/3/2019

Feedback loop 

What benefit that this project bring to people?

What do you considered success?

Initial Ideas:

 

Idea1: 

A piece of garment that is able to show people's emotion by detecting motions such as heartbeat.

 

Idea2:

Two sets of garments that people that enables a pair of people to share heartbeat with each other, achieving communications with their physical reactions. 

Idea3:

A piece of garment that reflect whether a persons is telling a truth or a lie.