It seems 1881 most of the houses were known by a name - the house George was in was called "Shell Cottage" -often at that time villages didn't have street names . If you follow the enumerater's walk you will notice addresses 3, 2 & 1 Atoll House , then Shell Cottage, followed by Venntor House and then the Queens Hotel.
So if you can locate the Queens Hotel at that time -Shell Cottage will be pretty close to it.
In 1891 George is not at No 41 Village Rd- no 41 is in a different column and refers to the Schedule number-which is not the house number. None of the houses have numbers -the address is just Village Rd - this could have been an official name for the Road at that time -or it could just be a reference to "the main road through the village"-which could have been changed in later years (often the main thoroughfare of a village was given the name High Rd/St/ main St -or suchlike)
If you put "Primrose Avenue Onchan " into a search engine you should get a few hits.
I found a house for sale in Primrose Avenue
I found Hildersley Rd metioned in a 1960's athletic club programme - it was classed as being in Douglas -maybe the boundary changed over the years
Suz