Virtual Deaf Interpreter?

starrygaze · 09-13-2007, 11:26 AM

IBM Develops Virtual Deaf Interpreter
Sign In to E-Mail or Save This
Print

By THE ASSOCIATED PRESS

Published: September 12, 2007

Filed at 9:07 p.m. ET

Here's a productive twist on the animated characters known as avatars that carry out fantasies in virtual computer worlds. IBM Corp. researchers have developed an avatar that can translate spoken words into sign language.

The technology is meant for use in the real world and could be useful when human interpreters for the deaf are unavailable, or when a conversation is sensitive. Imagine sitting through a lecture and seeing a digital character projected on a screen behind the speaker, interpreting the speech in real time.

The IBM team and advocates for the deaf caution that the system is still a prototype. It also works only with British Sign Language for now because it was created at an IBM research center in Hursley, England.

But the system, known as SiSi (for ''Say It Sign It''), is expected to move out of the labs and into commercial products. It is designed to be baked into other vendors' deaf-accessibility products and expanded to include other countries' sign languages.

SiSi works by using speech recognition to convert a conversation into text. From there, SiSi translates the text into the gestures used in sign language and animates a customizable avatar that carries them out.

------

On the Net:

YouTube - IBM Voice-to-Sign Language Translation Tech

Etoile · 09-14-2007, 01:49 PM

It won't catch on for a long time, I think. For one thing, is it really interpreting into sign language, or does it use English word order and everything is just converted? How does it handle facial expressions? Will it look exactly like a human (like in the Final Fantasy movie) or will it look very blocky, kind of like a character on Second Life? How will it handle interpreting from sign back into English? How fast will it go, how jerky will it be?

They've been creating "virtual interpreters" for a long time now, but I have never heard of one that a deaf person would want instead of a real one.

starrygaze · 09-16-2007, 08:08 AM

I m not comfort with virtual. Real interpreting is better and can sign more senses. I dont dare with stupid digital freak.

Interpretrator · 09-16-2007, 06:13 PM

Quote:

Originally Posted by Etoile

They've been creating "virtual interpreters" for a long time now, but I have never heard of one that a deaf person would want instead of a real one.

Oh I don't know...I've encountered a few interpreters who, were I a deaf consumer, I would pick the computer over them.

Reba · 09-16-2007, 09:14 PM

Oh, you bad!

Freaky Cat · 09-17-2007, 10:40 AM

http://www.alldeaf.com/deaf-news/450...terpreter.html

09-13-2007, 11:26 AM	#1 (permalink)
starrygaze Sundog Join Date: Sep 2005 Location: Shinar (Sumer) Posts: 2,315	Virtual Deaf Interpreter? IBM Develops Virtual Deaf Interpreter Sign In to E-Mail or Save This Print By THE ASSOCIATED PRESS Published: September 12, 2007 Filed at 9:07 p.m. ET Here's a productive twist on the animated characters known as avatars that carry out fantasies in virtual computer worlds. IBM Corp. researchers have developed an avatar that can translate spoken words into sign language. The technology is meant for use in the real world and could be useful when human interpreters for the deaf are unavailable, or when a conversation is sensitive. Imagine sitting through a lecture and seeing a digital character projected on a screen behind the speaker, interpreting the speech in real time. The IBM team and advocates for the deaf caution that the system is still a prototype. It also works only with British Sign Language for now because it was created at an IBM research center in Hursley, England. But the system, known as SiSi (for ''Say It Sign It''), is expected to move out of the labs and into commercial products. It is designed to be baked into other vendors' deaf-accessibility products and expanded to include other countries' sign languages. SiSi works by using speech recognition to convert a conversation into text. From there, SiSi translates the text into the gestures used in sign language and animates a customizable avatar that carries them out. ------ On the Net: YouTube - IBM Voice-to-Sign Language Translation Tech

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Today
Deafness	Sponsored Links __________________ This advertising will not be shown in this way to registered members. Register your free account today and become a member on AllDeaf.com

09-14-2007, 01:49 PM	#2 (permalink)
Etoile HOH terp Join Date: Dec 2005 Location: Washington DC Posts: 872	It won't catch on for a long time, I think. For one thing, is it really interpreting into sign language, or does it use English word order and everything is just converted? How does it handle facial expressions? Will it look exactly like a human (like in the Final Fantasy movie) or will it look very blocky, kind of like a character on Second Life? How will it handle interpreting from sign back into English? How fast will it go, how jerky will it be? They've been creating "virtual interpreters" for a long time now, but I have never heard of one that a deaf person would want instead of a real one.

09-16-2007, 08:08 AM	#3 (permalink)
starrygaze Sundog Join Date: Sep 2005 Location: Shinar (Sumer) Posts: 2,315	I m not comfort with virtual. Real interpreting is better and can sign more senses. I dont dare with stupid digital freak.

09-16-2007, 09:14 PM	#5 (permalink)
Reba Premium Member Join Date: Jun 2004 Posts: 16,091	Oh, you bad!

09-17-2007, 10:40 AM	#6 (permalink)
Freaky Cat Lost in Space Join Date: Apr 2003 Location: ArKaNsAs Posts: 10,159	http://www.alldeaf.com/deaf-news/450...terpreter.html