Final Project – Precedents
1.1 Micro Expression Tool
The tool was designed by Micro expression researcher Paul Ekkman as a means to train individuals in spotting subtle expression shifts in individuals during face to face interactions.
Synesketch is a free open source textual emotion recognition and visualization software that analyse the emotional content of text sentences in terms of emotional types (happiness, sadness, anger, fear, disgust, and surprise), weights (how intense the emotion is), and a valence (is it positive or negative) and displays it through art form.
EmoVoice is a comprehensive framework for real-time recognition of emotions from acoustic properties of speech. Linking output to other applications is easy and thus allows the implementation of prototypes of affective interfaces.
1.4 Museum of Feelings (2015)
The Museum of Feelings, located in Brookfield Place is a museum that reacts to emotions– and turns them into art. Its facade changes color with New York City’s mood using social media and real-time data from sources like the New York Stock Exchange, local news, weather reports and flight delays. It uses other data like individual heart beats and Galvanic Skin Response to create emotion-reflecting selfies for visitors.
The museum contains five galleries called “experience zones” where visitors can use their senses to explore their emotions, and each room has a Glade scent to encourage visitors to connect special experiences with smells.
1.5 Microsoft Project Oxford
Project Oxford is a toolkit developed by Microsoft that allows developers to create smarter apps, which can do things like recognize faces and interpret natural language even if the app developers are not experts in those fields.
1.6 Her (Film by Spike Jonze)
The science fiction love story Her, introduces the main character to a realistic artificial intelligence operating system that is able portray emotions and infer emotions of the main character through verbal and non verbal communication.
1.7 Hal (2001 A Space Odyssey)
Hal in the film is an artificial intelligence that takes control over the actions over its main character when he begins to express emotions of doubt. This is a case where emotion analysis through machine over rides human control in a situation.
Final Project -Domains
2.1 Emotions through Non Verbal Communication
Emotion defined by Merriam Webster is a brief conscious experience characterized by intense mental activity and a high degree of pleasure or displeasure. Emotion is often intertwined with mood, temperament, personality, disposition, and motivation. These emotional processes are conveyed and reciprocated through verbal and nonverbal communication. This study aims to explore emotions through the non verbal communication relationship between people.
Nonverbal communication between people is communication through sending and receiving wordless clues. It includes the use of visual cues such as body language (kinesics), distance (proxemics) and physical environments/appearance, of voice (paralanguage) and of touch (haptics).
Although spoken language is normally used for communication information, non verbal communications are used to establish and maintain interpersonal relationships. Michael Argyle (1970) a psychologist who pioneered social psychology in Britain expresses that it is considered more polite, or nicer to communicate attitudes towards other non-verbally rather than verbally. He concludes that there are five primary functions of non verbal behavior in human condition.
- to Express emotions
- to Express interpersonal attitudes
- to accompany speech in managing the cues of interaction between speakers and listeners
- to self-present one’s personality
- to do Rituals (greetings)
2.2 Kinesics The study would focus more on kinesics which is the study of body movements. The aspects of kinesics are face, eye contact, gesture, posture, body movements.
Face: The face and eyes are the most expressive means of body communication. It can facilitate or hamper feedback.
Eye contact: It is the most powerful form of non-verbal communication. It builds emotional relationship between listener and speaker.
Gesture: It is the motion of the body to express the speech.
Posture: The body position of an individual conveys a variety of messages.
Body movement: Used to understand what people are communicating with their gestures and posture