The John Ward d Q4 1855 is probably the same John Ward whose accidental death was reported in the Nottingham Journal, 16th November 1855. The article is a little long to post in its entirety.
In summary, a new pit shaft was being sunk at Shireoaks. Five men were working in the shaft when a waggon fell into the shaft. Of the five men, three were unhurt, one was injured, and the fifth man, John Ward was crushed and died (the account of his injuries is quite graphic).
Two details point to this being your John Ward:
1) His remains were conveyed to his home at Worksop (Shireoaks is to the NW of Worksop and was a separate place at that time.)
2) "Ward has left a wife very near her confinement and a numerous family totally unprovided for." This would be Joshua Henry b Q1 1856.
The Ward family living at Newgate Street in Worksop in 1851 and 1861 fits with your details. Although John Ward is recorded as Ag Lab in 1851, in 1861 his widow Mary is "formerly coal miner's wife".
If this Ward family is yours then one thing doesn't fit with your initial post: Richard, who you say was born 1853 is recorded in the 1851 census as 7 months old.