Hi,
I think I've found George in 1861

Transcribed as George HUBBARD but the Hubbard has what looks like RIMMINGTON written above it.
1861 RG9/2505 f.68 p.18 Litchurch, Derbyshire
58 Regent Street
George HUBBARD
Rimmington Lodger Mar 34 Commercial Traveller Leicestershire Wymond.. .
Lodging in the hosehold of Ann TOMLINSON
I found this George Rimington of the right age,
George Rimington
Age: 43
Wine Merchant
Great Britain
Ship Name: American Union
Port of Departure: London, England
Arrival Date: 6 Apr 1870
Port of Arrival: New York
(my own transcription from the image)
I can't find anymore about this chap so I thought I'd mention it just in case.
Maybe getting one of the children's birth certificates to find George's occupation might help.
Regards,
Daisy