Do not slurp text when switching from find to replace

I will frequently press ctrl+f to open find and write a regex, then decide that I want to do a replace with it. When I press ctrl+h to switch modes, it slurps up the current selection, which is whatever my regex was selecting, when I wanted to preserve my regex.