The Point ID On / Off in the View Filter Manager is meant to be a Quick Review of Point ID. The sizze is set by the Text Settings in Support - Options - there are 3 text settings there and the first I think off the top of my head is the one that controls this. It is designed to always be the same height when you zoom in and out - it was not designed for Plotting / printing purposes.
To control Labels on Printouts you should use Label Points command and set up a Point label Style that has Text Style set to Sheet Units - that way when you plot at different scales the text Height will always be the height you set no matter the scale vs Ground Units which sets the text so that it is "Painted on the Ground" and it stays a constant height which increases or decreases in size based on scale.
If you set up Point label Styles in your default Project Template, they will always be there for you when you want them - same with all your text Styles and Label Tables etc.
Alan