I suspect you're right. I'm not interested in the neighbours of everyone in my extended family tree.
Many years ago, before the census records were indexed, I went through specific cities page by page, looking for family members. Then I'd have to do it all over again, because what I'd learned sent me backwards or forwards in time.
It did give me a sense of which extended family members lived nearby, and that can be interesting, but it's really only do-able in a small village, town or city. Imagine trying to track all the Reillys in Boston and then trying to figure out if any of them were related to me -- what a colossal waste of time that would be (for my purposes, anyway).