Im a rec rated player. I dont have the consistency to play intermediate or above. I can play with advanced rater players for a casual round and finish a couple strokes behind them, but obviously tournament play is completely different.
If there is a 2 day tournament I try to play rec to compete against my division 'peers' and then will play intermediate the next day if that is how its split.
Its a comfort thing. I could give 2 $hits if people look down on me for the division I play in. If thats what you are concerned with, you need another hobby