That's really the only way to look at it.They’re going to see you how they see you, my friend. There’s nothing you can do about that. Be yourself, be at ease….. their opinion means nothing in the big picture. If you and your new lady are cool with the age difference, that’s all that matters. Letting other people get into your heads about it, will certainly tarnish your new relationship a bit.
Naturally, I would be on my best behavior, but it would still be my behavior.