It's interesting that Joseph is recorded as "married" in the 1921 census !!!living 23 Eldon Road Smethwick with sister Elizabeth 1870 and brother John 1871.
Do you have the death certificate for Clare May Berry - for a cause of death.
There is a death for Rosina Williams ?1894 Birmingham WarwickshireAge 30Birth year1864
FreeBMD has her age as 39.