Hi Justin,
I just checked my mail before going to bed and saw your reply so logged back in.
I think this is spooky

1891 Census
6 Townhead, Primrose Cottage
TIDESWELL, DERBYSHIRE
RG12/2777/180/2
Thomas FLINT, 81,head, mar, fustian cutter, born Manchester
Esther, 53, mar, Manchester
1881 you have, married to Esther, living in Manchester
1871 he is a widower, youngest child 3mths, in Newton Lancs
1861 married to Kate, living in Newton, son SAMUEL,18 and TA DA- Mother Mary FLINT 76, born TIDESWELL

1851 Cant find yet
1841 In Manchester married to Mary
All these he has same occp, 2 much younger wives + lots of children. I think I have found all 3 marriages as well.
I am just hoping the 1881 Census Job, which looks like Jos is short for James and not Joseph.
Even if he is not your Jame's Father there is a definite connection to Tideswell.
Cheers,
Trish