Maybe have a check box that is the equivalent of "do not rank up." I still get points, keep current rank, and can rank down if beaten enough where applicable. I went from rank 19 to 20 without an initiated PvP for over a year and would use this option to not have a bigger target on my back unwillingly. Uncheck box when willing to rank up.