1861 census has Nathaniel:
Class: RG 9; Piece: 2504; Folio: 81; Page: 14
49 Ladles Gate, St Werburgh, Derby
Bannister, Henry  Head  M  42  General Cooper Employing an Apprentice  b Derby
Bannister, Eliza  Wife  F  38  b Shardlow
Bannister, Charles H  Son  M  11  Scholar  b Birmingham
Bannister, Maria  Daughter  F  8  Scholar  b Birmingham
Bannister, Emily  Daughter  F  3  b Derby
Bannister, Anne  Daughter  F  2 months  b Derby
Sims, Nathaniel  Apprentice  M  20  Coopers Apprentice  b Shardlow