Sorry this is piecemeal, but I'm gradually working back. George Harrison married Sophia Standing, Jun 1862, Scarbro 9d, 467.
On the 1861 census George Harrison is a widower living at 39 Dumple St, Scarborough. He is aged 31, keeps a Refreshment House, and was born in Driffield. With him are Harry, Thomas and Robert as before, plus son Leonard aged 1, b. Scarborough. Also:
Elizabeth Vassalli, 15, general servant, b.Scarborough
Jane Harrison, mother, 45, housekeeper, b.Malton
So you can work out which of the children were Sophia's in the 1871 and onwards - but not what happened to George after 1861. Let me know if you want any more research - unless somebody beats me to it.