You can pick up a neighbor's HomePlug traffic if they are just on the same transformer as you. So you don't have to be in a townhouse or apt for this to happen.
The trouble is that even though you have enough signal for an IP address, you may not get a very strong signal which could impact the download speeds.
I bet this is happing a lot more that people suspect.