Social Expression Toolkit
How can we monitor social expressions and provide adaptive feedback?

Jackie Lee, Heymian Wong, Anna Shcherbina
Affective Computing Group, MIT MEDIA LAB

Implementation
Social Expression Toolkit consists toolkits that allow researchers to implement and prototype ideas from social situations. We implement a real-time facial interaction platform (written in Python) based on Intel OpenCV face detect function.

Attention Meter is written in Python 2.5 with OpenCV and CVtypes.
Shybot is implemented with Attention Meter, Arduino BT, and Max/Msp/Jitter.
Skin Conductance Peak Detector (using HandWave Bluetooth module) [coming soon]



Attention Meter v0.0.1 for Mac by Jackie Lee
1)Download and install Python 2.5 (on OSX.4.11, I haven't tried OSX.10.5 yet.)
2)Install Xcode and X11 SDK (It gives you most packages you may need.)
3) Download opencv-1.0.0.tar.gz from SourceForge.net and unzip it.
4) cd into 'opencv' and do following commands (detail instructions from Mac OS X OpenCV Port):
a. $ mkdir build; cd build
b. $ ../configure CPPFLAGS="-I/opt/local/include" LDFLAGS="-L/opt/local/lib"
(You may add --without-python if you have an old python-wrapper.)
c. $ make
d. $ sudo make install
5) Download and unzip att_mac-0.0.1.zip
6) do $ python social_att.py (You should be able to get it running at this point. Please let me know if you can't.)



Attention Meter v0.0.1 for Win by Jackie Lee
1) Install Python 2.5
2) Unzip att_win-0.0.1.zip
3) run in command line > python social_att.py



Attention Meter v0.0.1 for OLPC('XO')
by Anna Shcherbina
1. From the terminal activity type:
$ yum install opencv opencv-devel opencv-python
(This should install all the needed forms of opencv)

2. Type:
$ wget http://eclecti.cc/files/2008/03/libhighguiso100-O /usr/lib/libhighgui.so.1.0.0

3. Put the program files in the "/home" directory. So if you just start python in that directory you should be able to run the files.

**The key to installing opencv is this download:
http://eclecti.cc/files/2008/03/libhighguiso100-O /usr/lib/libhighgui.so.1.0.0

It is a fix that allows opencv to work on the XO. There is more information about the fix on this site:
http://eclecti.cc/olpc/a-dirty-hack-for-opencv-on-the-olpc-xo.



Acknowledgement
I would like to thank Dr. Ted Selker and Jon Wetzel (MIT M. Eng.) for their valuable contribution to "Attention Meter" project. Previous versions can be download through here:

Attention Meter (in VC++) [source] [exe]
Face Interface (in VC++) [source] [exe]

(Last updated on July 2, 2008 )

 

Projects

Publications

Arts

Home

Jackie Chia-Hsun Lee
A
ffective Computing
MIT MEDIA LAB
20 Ames ST. E15-443D
Cambridge, MA 02139, USA
+1.617.452.5627 (office)
jackylee@media.mit.edu