Your number will be visible to all of your followers and non-followers if you have made changes in your privacy section. This means if you do not want your number to be visible to non-followers or even followers you can hide it by visiting the privacy tab. In this way, if you can allow who can see your number and who does not.