Cant see him immediatly in 1881.... this 1891 chap has the wrong middle initial, but enumeration errors are common, and I cant see another Charles HOLT born in the Stockport RD ....
1891 - RG12/3137; Folio 73; Page 11 - Bury, Lancs
Warth Fold - 2, Walker Street
Charles W Holt 37 Head Cotton Mill Manager born Lancs, Elton
Ellen Holt 41 Wife Rawtenstall
Herbert Holt 15 son Ramsbottom
Charles W [sic] Holt 13 Stockport