Facial recognition system

A facial recognition system is a computer application for automatically identifying or verifying a person from a digital image or a video frame from a video source. One of the ways to do this is by comparing selected facial features from the image and a facial database.

It is typically used in security systems and can be compared to other biometrics such as fingerprint or eye iris recognition systems.cite web
title=Facial Recognition Applications
accessdate=2008-06-04
publisher=Animetrics
url=http://www.animetrics.com/technology/frapplications.html]

Techniques

Traditional

Some facial recognition algorithms identify faces by extracting landmarks, or features, from an image of the subject's face. For example, an algorithm may analyze the relative position, size, and/or shape of the eyes, nose, cheekbones, and jaw. These features are then used to search for other images with matching features.cite web|last=Bonsor|first=K.|title=How Facial Recognition Systems Work
accessdate=2008-06-02
url=http://computer.howstuffworks.com/facial-recognition.htm] Other algorithms normalize a gallery of face images and then compress the face data, only saving the data in the image that is useful for face detection. A probe image is then compared with the face data.cite web
last=Smith
first=Kelly
title=Face Recognition
accessdate=2008-06-04
url=http://www.biometrics.gov/Documents/FaceRec.pdf]

Popular recognition algorithms include eigenface, fisherface, the Hidden Markov model, and the neuronal motivated dynamic link matching.

3-D

A newly emerging trend, claimed to achieve previously unseen accuracies, is three-dimensional face recognition. This technique uses 3-D sensors to capture information about the shape of a face. This information is then used to identify distinctive features on the surface of a face, such as the contour of the eye sockets, nose, and chin.cite web
last=Williams
first=Mark
title=Better Face-Recognition Software
accessdate=2008-06-02
url=http://www.technologyreview.com/Infotech/18796/?a=f]

One advantage of 3-D facial recognition is that it is not affected by changes in lighting like other techniques. It can also identify a face from a range of viewing angles, including a profile view.

Skin texture analysis

Another emerging trend uses the visual details of the skin, as captured in standard digital or scanned images. This technique, called skin texture analysis, turns the unique lines, patterns, and spots apparent in a person’s skin into a mathematical space.

Tests have shown that with the addition of skin texture analysis, performance in recognizing faces can increase 20 to 25 percent.

Notable users and deployments

The London Borough of Newham, in the UK, has a facial recognition system built into their borough-wide CCTV system.

The German Federal Police use a facial recognition system to allow voluntary subscribers to pass fully automated border controls at Frankfurt Rhein-Main international airport. Subscribers need to be European Union or Swiss citizens.Fact|date=June 2008
Griffin Investigations is famous for its recognition system used by casinos to catch card counters and other blacklisted individuals.

The Australian Customs Service has an automated border processing system called SmartGate that uses facial recognition. The system compares the face of the individual with the image in the e-passport microchip, certifying that the holder of the passport is the rightful owner.

Pennsylvania Justice Network searches crime scene photographs and CCTV footage in the mugshot database of previous arrests. A number of cold cases have been resolved since the system became operational in 2005. Other law enforcement agencies in the USA and abroad use arrest mugshot databases in their forensic investigative work.

U.S. Department of State operates one of the largest face recognition systems in the world with over 75 million photographs that is actively used for visa processing.

Spaceship Earth in EPCOT uses this for the touch screen part of the ride.

Additional uses

In addition to being used for security systems, authorities have found a number of other applications for facial recognition systems. While earlier post 9/11 deployments were well publicized trials, more recent deployments are rarely written about due to their covert nature.

At Super Bowl XXXV in January 2001, police in Tampa Bay, Florida, used Indentix’s facial recognition software, FaceIt, to search for potential criminals and terrorists in attendance at the event.cite web|last=Bonsor|first=K.|title=How Facial Recognition Systems Work|accessdate=2006-06-18|url=http://computer.howstuffworks.com/facial-recognition.htm] (it found 19 people with pending arrest warrants)cite web|last=McNealy|first=Scott|title=Privacy is (Virtually) Dead |accessdate=2006-12-24|url=http://www.jrnyquist.com/aug20/privacy.htm]

In the 2000 presidential election, the Mexican government employed facial recognition software to prevent voter fraud. Some individuals had been registering to vote under several different names, in an attempt to place multiple votes. By comparing new facial images to those already in the voter database, authorities were able to reduce duplicate registrations. [cite web |url = http://findarticles.com/p/articles/mi_m0EIN/is_2000_May_11/ai_62019954
title = Mexican Government Adopts FaceIt Face Recognition Technology to Eliminate Duplicate Voter Registrations in Upcoming Presidential Election
accessdate = 2008-06-02
publisher = Business Wire] Similar technologies are being used in the United States to prevent people from obtaining fake identification cards and driver’s licenses. [cite web
url = http://www.oregon.gov/ODOT/DMV/news/cards_facialrec.shtml
title = Facial recognition at DMV
accessdate = 2007-09-17
last = House
first = David
publisher = Oregon Department of Transportation
quote = Oregon DMV is going to start using “facial recognition” software, a new tool in the prevention of fraud, required by a new state law. The law is designed to prevent someone from obtaining a driver license or ID card under a false name.] [cite news
first = Zac
last = Schultz
title = Facial Recognition Technology Helps DMV Prevent Identity Theft
url = http://www.nbc15.com/news/headlines/2684991.html
publisher = WMTV News, Gray Television
accessdate = 2007-09-17
quote = Madison: ...The Department of Motor Vehicles is using... facial recognition technology [to prevent ID theft] ]

There are also a number of potential uses for facial recognition that are currently being developed. For example, the technology could be used as a security measure at ATM’s; instead of using a bank card or personal identification number, the ATM would capture an image of your face, and compare it to your photo in the bank database to confirm your identity. This same concept could also be applied to computers; by using a webcam to capture a digital image of yourself, your face could replace your password as a means to log-in.

As part of the investigation of the Disappearance of Madeleine McCannthe British police are calling on visitors to the Ocean Club Resort, Praia da Luz in Portugal or the surrounding areas in the two weeks leading up to the child's disappearance on Thursday 3 May, 2007 to provide copies of any photographs of people taken during their stay, in an attempt to identify the abductor using a biometric facial recognition application.cite news|url=http://www.madeleine.ceopupload.com/|title=Help find Madeleine McCann|publisher=Child Exploitation and Online Protection Centre|date=2007-05-21|accessdate = 2007-05-21] [cite news
first = David
last = Brown
title = We will travel anywhere to find Madeleine, say parents
url = http://www.timesonline.co.uk/tol/news/world/europe/article1826735.ece
publisher = Times Online
accessdate = 2008-06-02 ]

Comparative study

Among the different biometric techniques facial recognition may not be the most reliable and efficient but its great advantage is that it does not require aid from the test subject. Properly designed systems installed in airports, multiplexes, and other public places can detect presence of criminals among the crowd. Other biometrics like fingerprints, iris, and speech recognition cannot perform this kind of mass scanning. However, questions have been raised on the effectiveness of facial recognition software in cases of railway and airport security.

Criticisms

Weaknesses

Face recognition is not perfect and struggles to perform under certain conditions. Ralph Gross, a researcher at the Carnegie Mellon Robotics Institute, describes one obstacle related to the viewing angle of the face: "Face recognition has been getting pretty good at full frontal faces and 20 degrees off, but as soon as you go towards profile, there've been problems."

Other conditions where face recognition does not work well include poor lighting, sunglasses, long hair, or other objects partially covering the subject’s face, and low resolution images.

Effectiveness

Critics of the technology complain that the London Borough of Newham scheme has, as of 2004, never recognized a single criminal, despite several criminals in the system's database living in the Borough and the system having been running for several years. "Not once, as far as the police know, has Newham's automatic facial recognition system spotted a live target." [cite news|first=James|last=Meek|title=Robo cop|url=http://www.guardian.co.uk/Archive/Article/0,4273,4432506,00.htm|publisher=UK Guardian newspaper|date=2002-06-13] [cite news|url=http://www.enterstageright.com/archive/articles/0102/0102facerecog.htm|publisher=Enter Stage Right|title=Is face recognition just high-tech snake oil?|date=2002-01-14|first=Mike|last=Krause] This information seems to conflict with claims that the system was credited with a 34% reduction in crime - which better explains why the system was then rolled out to Birmingham also. [cite news
url=http://www.allbusiness.com/government/government-bodies-offices-regional/6111139-1.html
publisher=Business Wire
title=Birmingham City Centre CCTV Installs Visionics' FaceIt
date=2008-06-02]

An experiment by the local police department in Tampa, Florida, had similarly disappointing results. [cite news|url=http://www.enterstageright.com/archive/articles/0102/0102facerecog.htm|publisher=Enter Stage Right|title=Is face recognition just high-tech snake oil?|date=2008-06-02|first=Mike|last=Krause]

"Camera technology designed to spot potential terrorists by their facial characteristics at airports failed its first major test at Boston's Logan Airport" [cite news
first=Richard
last=Willing
url=http://pqasb.pqarchiver.com/USAToday/access/391952771.html?dids=391952771:391952771&FMT=ABS&FMTS=ABS:FT&date=Sep+2%2C+2003&author=Richard+Willing&pub=USA+TODAY&edition=&startpage=A.03&desc=Airport+anti-terror+systems+flub+tests+%3B+Face-recognition+technology+fails+to+flag+%27suspects%27
format=Abstract
title=Airport anti-terror systems flub tests; Face-recognition technology fails to flag 'suspects'
publisher=USA Today
date=2003-09-02
accessdate= 2007-09-17]

Privacy concerns

Despite the potential benefits of this technology, many citizens are concerned that their privacy will be invaded. Some fear that it could lead to a “total surveillance society,” with the government and other authorities having the ability to know where you are, and what you are doing, at all times. This is not to be an underestimated concept as history has shown that states have typically abused such access before. [cite web
url = http://terrorism.about.com/od/civillibertiesissues/i/facialrecsoft_2.htm
title = Civil Liberties & Facial Recognition Software
accessdate = 2007-09-17
publisher = About.com, The New York Times Company
pages = "pp. 2"
archiveurl = http://web.archive.org/web/20060301220151/terrorism.about.com/od/civillibertiesissues/i/facialrecsoft_2.htm
archivedate = 2006-03-01
quote = A few examples which have already arisen from surveillance video are: using license plates to blackmail gay married people, stalking women, tracking estranged spouses...]

Recent Improvements

In 2006, the performance of the latest face recognition algorithms were evaluated in the Face Recognition Grand Challenge. High-resolution face images, 3-D face scans, and iris images were used in the tests. The results indicated that the new algorithms are 10 times more accurate than the face recognition algorithms of 2002 and 100 times more accurate than those of 1995. Some of the algorithms were able to outperform human participants in recognizing faces and could uniquely identify identical twins.cite web
last=Williams
first=Mark
title=Better Face-Recognition Software
accessdate=2008-06-02
url=http://www.technologyreview.com/Infotech/18796/?a=f]

Early development

Pioneers of Automated Facial Recognition include: Woody Bledsoe, Helen Chan Wolf, and Charles Bisson.

During 1964 and 1965, Bledsoe, along with Helen Chan and Charles Bisson, worked on using the computer to recognize human faces (Bledsoe 1966a, 1966b; Bledsoe and Chan 1965). He was proud of this work, but because the funding was provided by an unnamed intelligence agency that did not allow much publicity, little of the work was published. Given a large database of images (in effect, a book of mug shots) and a photograph, the problem was to select from the database a small set of records such that one of the image records matched the photograph. The success of the method could be measured in terms of the ratio of the answer list to the number of records in the database. Bledsoe (1966a) described the following difficulties:

This project was labeled man-machine because the human extracted the coordinates of a set of features from the photographs, which were then used by the computer for recognition. Using a graphics tablet (GRAFACON or RAND TABLET), the operator would extract the coordinates of features such as the center of pupils, the inside corner of eyes, the outside corner of eyes, point of widows peak, and so on. From these coordinates, a list of 20 distances, such as width of mouth and width of eyes, pupil to pupil, were computed. These operators could process about 40 pictures an hour. When building the database, the name of the person in the photograph was associated with the list of computed distances and stored in the computer. In the recognition phase, the set of distances was compared with the corresponding distance for each photograph, yielding a distance between the photograph and the database record. The closest records are returned.

This brief description is an oversimplification that fails in general because it is unlikely that any two pictures would match in head rotation, lean, tilt, and scale (distance from the camera). Thus, each set of distances is normalized to represent the face in a frontal orientation. To accomplish this normalization, the program first tries to determine the tilt, the lean, and the rotation. Then, using these angles, the computer undoes the effect of these transformations on the computed distances. To compute these angles, the computer must know the three-dimensional geometry of the head. Because the actual heads were unavailable, Bledsoe (1964) used a standard head derived from measurements on seven heads.

After Bledsoe left PRI in 1966, this work was continued at the Stanford Research Institute, primarily by Peter Hart. In experiments performed on a database of over 2000 photographs, the computer consistently outperformed humans when presented with the same recognition tasks (Bledsoe 1968). Peter Hart (1996) enthusiastically recalled the project with the exclamation, "It really worked!"

By about 1997, the system developed by Christoph von der Malsburg and graduate students of the University of Bochum in Germany and the University of Southern California in the United States outperformed most systems with those of Massachusetts Institute of Technology and the University of Maryland rated next. The Bochum system was developed through funding by the United States Army Research Laboratory. The software was sold as ZN-Face and used by customers such as Deutsche Bank and operators of airports and other busy locations. The software was "robust enough to make identifications from less-than-perfect face views. It can also often see through such impediments to identification as mustaches, beards, changed hair styles and glasses—even sunglasses". [cite news|title="Mugspot" Can Find A Face In The Crowd -- Face-Recognition Software Prepares To Go To Work In The Streets|url=http://www.sciencedaily.com/releases/1997/11/971112070100.htm|publisher=ScienceDaily|date=12 November 1997|accessdate=2007-11-06]

In about January 2007, image searches were "based on the text surrounding a photo," for example, if text nearby mentions the image content. Polar Rose technology can guess from a photograph, in about 1.5 seconds, what any individual may look like in three dimensions, and thought they "will ask users to input the names of people they recognize in photos online" to help build a database.Fact|date=June 2008

Future Developments-Retailing

A possible future application for facial recognition systems lies in retailing. A retail store (for example,a grocery store) may have cash registers equipped with cameras,the cameras would be aimed at the faces of customers,so pictures of customers could be obtained. The camera would be the primary means of identifying the customer,and if visual identification failed,the customer could complete the purchase by using a PIN (personal identification number). After the cash register had calculated the total sale,the face recognition system would verify the identify of the customer and the total amount of the sale would be deducted from the customer's bank account. Hence,face-based retailing would provide convenience for retail customers,since they could go shopping simply by showing their faces,and there would be no need to bring debit cards,or other financial media. Wide-reaching applications of face-based retailing are possible,including retail stores,restaurants,movie theaters,car rental companies,hotels,etc.

ee also

* Three-dimensional face recognition
* Automatic number plate recognition
* Eigenface
* Face perception
* Mass surveillance
* Pattern recognition, analogy and case-based reasoning
* MALINTENT

External links

* [http://www.face-rec.org/ Face Recognition Homepage]
* [http://s.i-techonline.com/Book/Face-Recognition/ISBN978-3-902613-03-5.html Book: Face Recognition]
* [http://shop.lenovo.com/SEUILibrary/controller/e/web/LenovoPortal/en_US/catalog.workflow:expandcategory?current-catalog-id=12F0696583E04D86B9B79B0FEC01C087&current-category-id=C46D71ACFD7C4475B8E490358F8CA8C3&tab=2#tab-container-5 Veriface - Don't use a password to lock your computer, just look into the camera]
* [http://www.auroracs.co.uk Aurora - The UK's leading provider of face recognition systems]
* [http://www.luxand.com/facesdk/ Luxand FaceSDK - Face Detection SDK for software developers]
* [http://www.SensibleVision.com FastAccess - Sensible Vision's facial recognition software for computer workstation access control ]
* [http://www.betaface.com Betaface - Face Detection and Recognition Technology] (images, video files and realtime video streaming)
* [http://www.picporta.com picporta - An online face based picture organiser]
* [http://www.activeface.net ActiveFace Face Recognition C# Control for Visual Studio]
* [http://www.myfaceid.com MyFaceID] - online media search platform based on facial recognition
* [http://www.ayonix.com Ayonix Face Recognition Products]
* [http://www.orckr.com Face Detection and Distortion ONLINE]
* [http://www.xidtech.com/Face%20Synthesis.htm XID Technologies 3D face synthesis - Enhancing Face Recognition]
* [http://www.cs.technion.ac.il/~mbron/research_facerec.html Technion 3D face recognition project]
* [http://3dface.eu 3dFIT System] - Research of commercial 3D face recognition system, doctorate project, Poland
* [http://www.facedetection.com/ Face Detection Homepage]
* [http://computer.howstuffworks.com/facial-recognition.htm Introduction from "How Stuff Works"]
* [http://www.face2match.com/en face2match] - dating community based on facial recognition
* [http://www.recogmission.com Recogmission image search and indexing system] - image indexing system based on face recognition technology
* [http://www.sourcesecurity.com/news/articles/co-1645-ga.2208.html Impact of biometrics and facial recognition systems on security industry]
* [http://www.x-pin.com/ x-pin.com - Face Recognition Products, SDK, x-ident Video Identification, Smart Acces]
* [http://www.cbsr.ia.ac.cn/users/szli/FR-Handbook/ Handbook of Face Recognition]