As you noted they are aiming it at ‘their’ driveway. You house presumably just happens to be there, I doubt they have any desire to look in your house window. Aiming it at their driveway for most of us is not a fascination, rather you can see who is coming and going. Such as when Amazon says they delivered to your front door but you have footage of them throwing in your driveway, or video of someone driving by and looking in your mailbox, or when a snow plowed denies having hit your mailbox, and countless other relatively common scenarios beyond that of course capturing a burgler.
I think you would agree that his ownership ends where my begins. I understand rationale used. I have problem with the rationale stepping over the line of my property. We don't automatically accept excessive noise from neighbors. Why can't surveillance work the same way? Maybe tilt the camera not to violate my privacy? Is that so much to ask?