Machines now beat humans at lip-reading

Thu Oct 15, 2009 2:33PM EDT

See Comments (25)

How do I know you're lying? My computer is watching your lips moving.

Once again computers are proving more capable at something that has long been the domain of humans.

Nothing all that unusual here, really: Machine-based lip recognition systems have finally advanced to the point where they can detect with 80 percent accuracy what a person is saying, in the absence of audio. Humans score a pathetic 32 percent accuracy on average on the same job.

Even the researchers behind the study seem surprised by the lopsided results. Lip-reading is known to be a difficult skill to pick up, but it's an increasingly vital skill in the world today. As the linked story notes, 55 percent of people over 60 have some hearing loss, and lip reading is the only real way they can supplement what's left of their hearing to enhance the understanding and comprehension of what's being said to them.

In this case, the increased accuracy of computers at lip-reading is actually something to celebrate and which can be put to good use by us lowly carbon-based lifeforms. The old method of teaching people how to lip-read mainly involved schooling them with illustrated books that show how lips are shaped during various sounds. With advances in computer technology, new training methods involving video -- possibly even interactive -- can be developed to teach the hard of hearing how to better recognize lip formations and movements -- especially with notoriously tricky monosyllabic words. Early results show that video training can show serious improvement in lip-reading skills in as little as four hours.

Comments on Machines now beat humans at lip-reading

Post a Comment

Join in the discussion. Here you'll see the comments in the order they were posted.

  • 2 Posted by dischuetz on Thu Oct 15, 2009 4:35PM EDT Report Abuse

    As one of millions of people with limited hearing who relies upon lip movement to supplement my understanding of what is said, I would be ecstatic to learn from a computer how to read lips better! I have never been formally trained, but have had some hearing loss since at least the age of 12, so have developed my own lip-reading ability - but it is far from perfect. Without the supplement of sound, I really cannot read lips much at all. But without the lip-reading, I do not understand most conversations. Oh, for a chance to try this computer method!!!

  • 4 Posted by alan_r_cam on Thu Oct 15, 2009 8:52PM EDT Report Abuse

    As used in surveillance to determine what the target is saying. Unless, of course, the target is a ventriloquist.

  • 5 Posted by wyattsherril on Thu Oct 15, 2009 9:19PM EDT Report Abuse

    That is such BS. The only people that can tell if Im lying are those closest to me. I think this world has gone crazy. Computers don't have souls....enough said.

More Posts: First Prev 1 2 Next Last

Post a Comment


My Tech

Please enable your browser's cookies to activate the My Tech column.

Also on Yahoo! Tech

Computers Home Office Wi-Fi & Networking Phones & PDAs Cameras & Camcorders TV & Home Theater Portable Audio
 

Question and Answer content at Yahoo! Tech is written by Yahoo! users at Yahoo! Answers. Yahoo! does not evaluate or guarantee the accuracy of any Yahoo! Answers content. For more information, read the Full Disclaimer.

Opinions expressed by the Advisors are their own and do not necessarily reflect the views of Yahoo! Inc. Yahoo! receives no compensation from any manufacturer or distributor nor does it compensate any Advisor for the coverage of any product or service in any Advisor's content.