I am involved with a woman 9 years older than I, and she is every bit young at heart and looks closer to my age. We are compatible and happy with our life, I wouldn't consider trying to seek another woman only to have a closer age range. Why should I? People have done it the "acceptable" way for years, and yet these relationships end up in a 50% chance for divorce. So if it works and both involved are happy, then pursue the relationship for yourselves, not what others think should be "righteous".
Therefore people that don't know that will continue to ridicule you for that.