Don't worry it will be ok, if they are using the box already they will know you are knocking about by now.
I've just been outside to top up the birdbaths and I can hear youngsters in a box no more than 3 yards from the house and right at the side of my path.
Alan...thanks a lot. That does make me feel a bit more relaxed. :)