I am only just starting to get into bees, but as a guess you could start a small fire near the hole (not close enough to burn them) and waft the smoke into the hole to encourage them to leave. but you may be better contacting your local bee keeping association and asking them to move them.

__________________
_____________
Cheers Chris

Its only a chilli if it burns your mouth