I agree!
We have a horse, and you'll find that most horse owners will happily leave spiders webs alone in a stable ( no matter how tatty and uncared for it looks) because those pesky flies which home in on horses will often get stuck in the webs.
Result...one less agitated horse!

Anyway- if you wiped off the webs without finding the spiders, they'd only create a new web!