No idea if this is your Samuel but have you investigated:
1851
HO107/2082/516/10
Transcribed as Wormlighton with ammendment to Wormleighton, so someone is also researching this family. However this Samuel is married to a 'Lucy' but he is a FWK. The writing is very feint and barely readable but it might be worth a look.

Of course both parents may have died, and the girls married?

I can't see Joseph either. The surname may have been mistranscribed/misinterpreted ... or they emmigrated ...
