Hi Chris,
I am researching Ann Middleton, who I think was Joseph's wife in England. Do you have any evidence that she died (other than his status on arrival in Australia)?
My research suggests that she lived with and had several children with my great-grandfather, John Rayner (born c1820, Wakefield) and is therefore my great-grandmother. She appears on the census with him between 1851 and 1881 and also died in 1888.
I can find no evidence that they ever married, although she used the name Rayner. The lack of a marriage would make sense, if she was still married to Joseph.
There is also a George Rayner on the 1851 census, who could be the younger of Joseph's two children (the age is right).
thanks
Kate