Remember, you're not at home alone where no one else can see you. Try to act like you have just a bit of polish and sophistication.
Um, boys? If you feel the need to 'adjust' yourself, visit the bathroom and do so in private. The rest of us don't want to be included in whatever power dynamic exists between you and your privates. Yes, they're still there. Don't worry. They're not going to fall off. Honest.
Same thing with fixing a wedgie.
And if the problem is frequent, it's either time for a very frank conversation with your doctor, or you need to change the size/style of your underwear. Seriously.