If you've ever stepped into your garden or onto your balcony and felt a curious gaze from next door, you're not alone.