Replace in Files opens tabs for all of the files with replacements

I don't get why Replace in Files is opening tabs for all of the files that it does replacements in, and then I have to save them and close them manually. I swear it used to just make the changes and save the files without opening them. Is there a setting I'm missing?

FYI, build 2183 here