Home People Projects Publications Policy Press FAQ Vintage

Data to Share

Data Sets from Affective Computing Research



Eight-Emotion Sentics Data:


This was the first data set generated as part of the MIT Affective Computing Group's research. The research question motivating the collection of this particular data was: Will physiological signals exhibit characteristic patterns when a person experiences different kinds of emotional feelings? In particular, we wanted to know if patterns could be found day-in day-out, for a single individual, that could distinguish a set of eight affective states (in contrast with prior emotion-physiology research, which focused on averaging results of lots of people over a single session of less than an hour.) We wanted to know if it might be possible to build a wearable computer system that could learn how to discriminate an individual's affective patterns, based on skin-surface sensing. We did build such a system, which attained 81% classification accuracy among the eight states studied for this data set. The pattern recognition aspects of this work are described in more detail in the article:

  • E. Vyzas (1999) "Recognition of Emotional and Cognitive States Using Physiological Data", Master's Thesis, Mechanical EngineeringTR-510

    These data are available to other researchers. The data consist of measurements of four physiological signals and eight affective states, taken once a day, in a session lasting around 25 minutes, for over twenty days of recordings. The four physiological signals are: blood volume pulse, electromyogram, respiration and skin conductance. The eight states (from the Clynes sentograph protocol) are: neutral, anger, hate, grief, love, romantic love, joy, and reverence. The data are divided into two overlapping sets, which are described in more detail in Healey's PhD thesis (2000): Wearable and Automotive Systems for the Recognition of Affect from Physiologyhere

    The data may be downloaded here:
    Eight-emotion-sentics Data Set A
    Eight-emotion-sentics Data Set B



    Permission is granted to use these data for research purposes. If your research with this data is published, please reference the data as: "Jennifer Healey and Rosalind W. Picard (2002), Eight-emotion Sentics Data, MIT Affective Computing Group, http://affect.media.mit.edu."



    Earlier publications where we used these data are:



  • E. Vyzas (1999), "Recognition of Emotional and Cognitive States Using Physiological Data", Mechanical Engineer's Degree Thesis, MIT, June 1999. TR 510.

  • Elias Vyzas and Rosalind W. Picard (1999), "Offline and Online Recognition of Emotion Expression from Physiological Data", Workshop on Emotion-Based Agent Architectures, Third International Conference on Autonomous Agents, May 1, 1999, Seattle WA TR 488.

  • Elias Vyzas and Rosalind W. Picard (1998),"Affective Pattern Classification", 1998 AAAI Fall Symposium Series: Emotional and Intelligent: The Tangled Knot of Cognition, October 23-25, 1998, Orlando, Florida. TR 473.

  • Jennifer Healey and Rosalind Picard (1997),"Digital Processing of Affective Signals",Proceedings of ICASSP, Seattle, Washington, May 12-15, 1998. TR 444 .

    Driver Stress Data:

    Four types of physiological sensors were used to monitor drivers in natural driving situations that included rest, city driving and highway driving tasks. Each drive lasted for approximately ninety minutes. Data was recorded using an electromyogram placed on the shoulder, an electrocardiograph rhythm trace, a sensor for detecting respiration through chest cavity expansion and skin conductance sensors on both the hand and the foot. During the drive, several video cameras were used to record the driver's facial expression, body motion and road conditions. These videos were synchronized to the physiological records to provide ground truth for analysis. A set of hand annotations of these videos has been partly created. This data has been given to be placed for free use by researchers on PhysioNet, as will the annotations when they are completed.

    These data are described in more detail in Healey's PhD thesis (2000): Wearable and Automotive Systems for the Recognition of Affect from Physiology TR 526


    The data can be downloaded from:PhysioNet.

    Permission is granted to use these data for research purposes. If your research with this data is published, please reference the data as: "Jennifer Healey and Rosalind W. Picard (2002), Driver Stress Data, MIT Affective Computing Group, http://affect.media.mit.edu."



    Some research using this data was published in:



  • Jennifer Healey and Rosalind W. Picard (2000), "SmartCar: Detecting Driver Stress", Proceedings of ICPR'00, Barcelona, Spain, May 2000. TR 525.