Hi
William Henry, if this is the one I found in the medical registers and 1861 census, married an Eliza born Sheffield. He was a GP in 1861. Ref RG9/3476/35/21
There might be a marriage announcement for these two which may lead you to Joseph's parents. William Henry qualified possibly 1840.
Evie