G_Imperatore

Hello guys,

My name is Gennaro, as part of my MSc degree in Computer Science I am developing an application for android to help the deaf.

It works by using Automatic Speech Recognition to translate the words of the person who is talking to the non hearing person. The deaf can then reply via keyboard and the hearing will hear the words via Text To Speech.

Would you help me design the app, via a short chatting session with about six participants.

Your help would be awesome.

Thanks.

Deafness

__________________
This advertising will not be shown in this way to registered members.
Register your free account today and become a member on AllDeaf.com

Bottesini

Why? We can text or email with no problem for either side.

If they can't go halfway to meet me, I don't want to talk to them.

There's also video chat for anyone who can use it, although I don't expect everyone to do that.

What you are talking about would be extremely cumbersome and inaccurate, and I would need to be reading the hearing person's end of the conversation since I can't talk on a telephone.

__________________

G_Imperatore

Yes that is the idea, the app looks like an IM application, and the idea is that deaf people can as close to real time as possible. The idea is also to help you in scenarios where SMS cannot do the job. like telephone banking, takeaway services, or any companies that do not have SMS support.

Anij

Wirelessly posted (Blackberry Bold )

What you're proposing is what IM and IP relay already do.

The only difference is that a real person converts the voice to text & vise versa - which is far more accurate and trustworthy.

__________________
Hoh/Deaf ~ +120db deaf right , mild/mod flux left & APD
English & ASL ...PAH!!


Ignorance is NOT Bliss

G_Imperatore

@Anij, the idea is to enable deaf to talk in every possible scenario, where IM cannot help them. There is also some cases in which you require privacy which you don't have with a relay operator

G_Imperatore

@Bottesini the idea is to help the deaf in situations where SMS and emails don't let them communicate. The purpose of the chat is to raise all of these issues so they can be included in the research

Anij

Wirelessly posted (Blackberry Bold )

Relay calls are "private" - in the same way sharing medical info with your dr is "private". Relay operators and interpreters are bound by confidentially agreements protecting their client.

Between email, text, IM, relay, VRS... Honestly it's very easy to communicate with anyone.

In person pen&paper, or typing on a mobile is quick and easy.

There's no way I'd give up accuracy for an automated translation for anything important.

Most mobile carriers already have automatic voice-to-text for voicemails such as SpinVoX. The accuracy depends so heavily on accent, annunciation, speed of speech, background noise etc that while helpful, it's certainly not something that could take relay's place.

__________________
Hoh/Deaf ~ +120db deaf right , mild/mod flux left & APD
English & ASL ...PAH!!


Ignorance is NOT Bliss

Anij

Wirelessly posted (Blackberry Bold )

Why don't you give us a few examples where you think this would be needed, and we can make suggestions from there.

__________________
Hoh/Deaf ~ +120db deaf right , mild/mod flux left & APD
English & ASL ...PAH!!


Ignorance is NOT Bliss

G_Imperatore

@Anij,

Basically my idea was to help you guys in situations like takeaway orders, bank, or emergency breakdowns that do not support SMS.

You have to understand that my examples are based on research not experience, so if that is why I need feedback from target users

G_Imperatore

Can you tell me what VRS is?

CSign

Video Relay Service

Anij

Wirelessly posted (Blackberry Bold )

Relay works for all the situations you mentioned ... I use it all the time for that.

You can access relay from your mobile/cell and place the order. Also many places allow you to email in orders as well (which again can be done via a mobile/cell).

__________________
Hoh/Deaf ~ +120db deaf right , mild/mod flux left & APD
English & ASL ...PAH!!


Ignorance is NOT Bliss

G_Imperatore

okay thanks for feedback. I am looking at scenarios where relay services are not so reeadily available and there is no support for email ordering. Like where I stay in Italy

Anij

Is ERS (Europe Relay Service) not available Italy?

__________________
Hoh/Deaf ~ +120db deaf right , mild/mod flux left & APD
English & ASL ...PAH!!


Ignorance is NOT Bliss

G_Imperatore

In many areas of the south of Italy you'd be surprise what is unavailable.

The education system does not support teaching of SL either.

radioman

you might be right vrs works for that- BUT only if you have signal. what if you just happened to be in the worst place at worst time? it would be nice to have extra stuff in the arsenal.

By the way - my android ALREADY has a voice to text but its far from perfect.

A Nihilist

If you want to see why computer voice recognition still needs some work go on youtube and watch any video and enable captions. It's also good for a laugh.

I would only do a computer relay system if it's 97% accurate.

G_Imperatore

The application would use both embedded speech recognition provided by the phone and speech recognition provided by google, there is also an algorithm for correction, but as I said the app needs to be designed first. What needs to be discussed is also your methods of entering text on the phone

would you be interested in taking part in a short on line discussion.

G_Imperatore

@ A Nihilist, with modern algorithms, there is very high accuracy we are talking about 70 80 percent. It's not perfect, but it is a research project

G_Imperatore

I am focusing on design aspects at the moment.

G_Imperatore

Anyone interested in taking part in the disussion please contact me at deafimapp@hotmail.it

Anij

Wirelessly posted (Blackberry Bold )

I'd suggest you get in contact with the people at Dragon Naturally Speaking - they'd likely be of significant value to you in terms of voice recognition software and it's limitations etc.

__________________
Hoh/Deaf ~ +120db deaf right , mild/mod flux left & APD
English & ASL ...PAH!!


Ignorance is NOT Bliss

G_Imperatore

My research does not focus on speech recognition but also on text entry and other design aspects which I need to discuss with deaf participants

Bottesini

You still didn't answer how would we know what the hearing person is saying?

It would either have to convert their voice to text, or they would need to text back, therefore making the whole thing a huge step down from just texting.

__________________

A Nihilist

You can just PM here.

As for entering data I like using a flip out QWERTY keyboard because of the physical response not to mention they have gaps between to prevent mistakes. I hate the virtual keyboards because they're too crammed together and there's no "feedback" if you pressed the key or not.

Bottesini

For entering data, I love my virtual keyboard with Swype technology.

__________________

A Nihilist

+1 Even though I "converse" with hearing folks I've found they'd rather just text me than use a relay system because for one thing they don't have to keep calling until I answer. With text messages you can just send and "forget it"

green427

What is the difference between what you are proposing and what is already available?

Each deaf person pronounces the same word differently, and there is already speech recognition software that listens to how we pronounce words and adapts accordingly.

What you propose is interesting, though, but, keep in mind that most deaf people communicate mostly by using their body parts more than their voices. Many deaf folks make the same sound for every word, so I would think that you are better off writing software that would convert body language to written text.

__________________
Warning: Anything I post may not make any sense. All advice is for entertainment value only. Sarcasm might be present. Interpret at your own risk.

Anij

Wirelessly posted (Blackberry Bold )

If you want to pm me you're welcome to.

__________________
Hoh/Deaf ~ +120db deaf right , mild/mod flux left & APD
English & ASL ...PAH!!


Ignorance is NOT Bliss

A Nihilist

I've used the Mobile IM relay system to call AAA when my car broke down. it's basically like doing an IM session on AOL but on the phone. It worked great no complaints.