It's just a grapple over the terminology. I'm sure use of the word audism turns up an ugly taste from any kind of deaf group, the same way 'deafism' is making those hearing wanderers who come here and find the 'what do you hate about hearing people' thread and say stuff like "These guys have prejudice against hearing".
The problem is that the word audism is being used to group nearly everything negatively associated with deafness. From discrimination, to 'handicappedness' to 'disability'. If the usage of terminology was properly divided up, it might not have came to be called reverse audism.
See this example: Some black guy is put down for whatever issue, mainly for the reason of his color.
For some, it can be seen as racism: not allowing blacks to achieve.
For others, it's a form of discrimination: failing to recognize them as a different group or minority
Another person may think teh black guy's opressor is prejudiced against blacks: being biased solely for the reason of an individual (or group's) opinion.
There's also stereotyping: opinion that blacks can't or can do this.
These words might seem like they all mean the same, but they can actually convey different meanings depending on the situation, and that is the problem with using the word audism - it is a group all for any form of intolerance of deaf people. That is also what causes the problem with the reverse audism definition.
In the end, some people from all groups will inadvertently put down another group in one form or another. This is a focus to bring light into what the issue really is.