On the 1881 census, if he is the William with daughter Margaret, he gives his birthplace as Crich.
So perhaps this is William in 1871?
Reference RG10, Piece 3587, Folio 40, Page 25
Tutchley, Crich, Derbyshire
Parents William(46) and Mary Richards (39).
Children John (19), William(17), Samuel(13), Margaret(12), Martha(9), Elizabeth(7) and Mary Ann(2 months).
As I can't find William in 1851 or 1841, I was wondering whether his mother remarried Mr Richards, and that your William had a different surname at birth?