As a starter, Joseph's birth is registered as December quarter 1848 Durham ( Actual reference hard to read)
Following the census records, Joseph was with his parents up to the 1881 census.The name of his mum seems to change but I didn't go into details as that is not your main concern. However the dates and his siblings and dad tally so Joseph was still in England and unmarried in April 1881.