Facial expression capture

Facial expression capture

Facial expression capture is a process of using video or mechanical means to manipulate computer generated characters with input from human faces, or to recognize emotions from a user. digital video methods are becoming increasingly preferred, as mechanical systems tend to be clunky and difficult to use.

Technology

Using digital cameras, the input user's expressions are processed to provide the head pose, which allows the software to then find the eyes, nose and mouth. The face is initially calibrated using a neutral expression. Then depending on the architecture, the eyebrows, eyelids, cheeks, and mouth can be processed as differences from the neutral expression. This is done by looking for the edges of the lips for instance and recognizing it as a unique object. Often contrast enhancing makeup or markers are worn, or some other method to make the processing faster. Like voice recognition, the best techniques are only good 90 percent of the time, requiring a great deal of tweaking by hand, or tolerance for errors.

Since computer generated characters don't actually have muscles, different techniques are used to achieve the same results. Some animators create bones or objects that are controlled by the capture software, and move them accordingly, which when the character is rigged correctly gives a good approximation. Since faces are very elastic this technique is often mixed with others, adjusting the weights differently for the skin elasticity and other factors depending on the desired expressions.

Usage

Several commercial companies are developing products that have been used, but are rather expensive.

It is expected that this will become a major input device for computer games once the software is available in an affordable format, but the hardware and software do not yet exist, despite the research for the last 15 years producing results that are almost usable.

External links

* [http://www.ri.cmu.edu/labs/lab_51.html Carnegie Mellon University]
* [http://citeseer.ist.psu.edu/cache/papers/cs/24653/http:zSzzSzwww.kbs.twi.tudelft.nlzSzPeoplezSzStaffzSzM.PanticzSzPAMIfinal.pdf/pantic00automatic.pdf/ Delft University of Technology ]
* [http://www.intel.com/technology/computing/opencv/overview.htm Intel]
* [ftp://ftp.dcs.shef.ac.uk/home/jedge/papers/03usereusemocap.pdf Sheffield and Otago]


Wikimedia Foundation. 2010.

Игры ⚽ Поможем сделать НИР

Look at other dictionaries:

  • Facial motion capture — is the process of electronically converting the movements of a person s face into a digital database using cameras or laser scanners. This database may then be used to produce CG (computer graphics) computer animation for movies, games, or real… …   Wikipedia

  • Computer facial animation — is primarily an area of computer graphics that encapsulates models and techniques for generating and animating images of the human head and face. Due to its subject and output type, it is also related to many other scientific and artistic fields… …   Wikipedia

  • Duchenne de Boulogne — Demonstration of the mechanics of facial expression. Duchenne and an assistant faradize the mimetic muscles of The Old Man …   Wikipedia

  • Mécanisme de la physionomie humaine — Mécanisme de la physionomie humaine. ou, Analyse électro physiologique de l expression des passions des arts plastiques. is a monograph on the muscles of facial expression, researched and written by Guillaume Benjamin Amand Duchenne de Boulogne,… …   Wikipedia

  • Emotion — For other uses, see Emotion (disambiguation). Emotional redirects here. For other uses, see Emotional (disambiguation). Emotions Affection Anger Angst Annoyance Anxiety Apathy Arousal Awe Bo …   Wikipedia

  • Computer animation — Further information: Animation and Computer generated imagery An example of computer animation which is produced in the motion capture technique Computer animation is the process used for generating animated images by using computer… …   Wikipedia

  • arts, East Asian — Introduction       music and visual and performing arts of China, Korea, and Japan. The literatures of these countries are covered in the articles Chinese literature, Korean literature, and Japanese literature.       Some studies of East Asia… …   Universalium

  • Nonverbal communication — is usually understood as the process of communication through sending and receiving wordless (mostly visual) messages. Messages can be communicated through gestures and touch (Haptic communication), by body language or posture, by facial… …   Wikipedia

  • nervous system, human — ▪ anatomy Introduction       system that conducts stimuli from sensory receptors to the brain and spinal cord and that conducts impulses back to other parts of the body. As with other higher vertebrates, the human nervous system has two main… …   Universalium

  • Mexico's Next Top Model, Cycle 1 — Promotional Photograph of Cycle 1 of Mexico s Next Top Model Format Reality television Created by …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”