AVEC 2017 menu

iBUG Smile Detectors

iBUG’s LAUD12 and TAUD12 are the implementations of our LBP respectively LPQ-TOP-based AU12 (smile) detectors. It is developed as a WIN32 executable. The model is trained on the MMI database. The input can either be a video sequence (.avi) or a set of images that form a video (.png). The system assumes that the image/video contains a frontal view of the face and that the video frame rate is 25 fps. Resampling will be required for videos with a different frame rate. The detector outputs a .csv file with its prediction for each frame (1 for active, -1 otherwise) and saves it in the same directory as that containing the images or the video. Note that TAUD12 is unable to detect a smile in the first and last couple of frames (the descriptors used are window-based, so for example when the window is of 11 frames it will not be possible to detect the activation of the AU for the first and last 5 frames). This is a first version of the software, further versions are expected in the near future.

More information about it can be found in:
Bihan Jiang, Michel F. Valstar, and Maja Pantic, ‘Action Unit detection using sparse appearance descriptors in space-time video volumes’, IEEE Int’l. Conf. Face and Gesture Recognition (FG’11), March 2011.

We kindly request that you cite this work if you decide to use this tool for research purposes.

You will need Matlab Component Runtime (MCR) installed on your computer for the program to run. We provide the executable to do this. MCR are version dependent. The code is compiled using version 7.14. If you have Matlab 2010b, then you already have it installed. Otherwise, keep in mind you might need to install it in order to run the executables. You can safely install different versions of MCR in your

LAUD12 is available from http://ibug.doc.ic.ac.uk/resources/laud-programme-20102011/
TAUD12 is available from http://ibug.doc.ic.ac.uk/resources/temporal-based-action-unit-detection/

Categories: face-analysis

Leave a Reply




You can use these HTML tags

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>