Thanks Susan! It IS going to be difficult to find that one out, but I have a new muddle.
I have found the death of a Henry Vickress who died in Wolverhampton in 1874 aged 45, which fits perfectly with the facts we already know about Henry Edward Vickress, son of William and Elizabeth, who was born in 1830. I have also found that Henry Edward Vickress married in Jun 1854 in Birmingham but the wife's name is a bit puzzling (it's either Eliza Haywood or Mary Davis); it seems the family eventually moved to Wolverhampton district, as he died there.
A daughter (I presume) called Jane died in Wolverhampton in Mar 1872 aged 4, a son called William Henry died at about the same time aged 3, and a daughter Drusilla (which is the name of one of Henry Edward's sisters 1817-1901) died at age 0 in Sep 1873. Henry Edward himself died two years after.