I think you're right in that, it either gives connotations to me as somebody who rents a cottage or similar living space.
However Cottager as I know it is (from my limited historical knowledge) somebody who rents a plot of land and works it as a farmer, as opposed to owning the farm OR similarly somebody who rents a living space from a farmer and works on the farm.
Does any of this fit in with what you know?