Have you seen this 1871 entry, boarding with William and Sarah Crowder in Newbold Derbyshire? Seems to be flexible regarding his age!
Name Henry Rithes, basket maker, married
Age 54
Estimated Birth Year 1817
Relation Boarder
born Carlisle
Civil parish Newbold
Registration District Chesterfield
Sub-registration district Chesterfield
ED, institution, or vessel 20
Household schedule number 151
Piece 3612
Folio 41
Page number 26
Not found him earlier yet.