In the criminal records on ancestry, he is Charles Lister, not Lester.
‘ Habitually Criminals Register’ - Charles Lister, alias Edward Hunt, Barman, born 1850, London.
For info 1871 census
Charles Lister Age 22
Relation Servant occ
barmanWhere born St Pancras, Middlesex
Piece 436 Folio 24 Page number 6
probably this is him on 1881 census
Charles Lister Age 31, single
Relationship to Head Prisoner
Where born London, Middlesex
Street Address "H M Convict Prison" Chatham Kent
Occupation Convict
Only looking for Grace - marriage to Mr Lester and her whereabouts in 1871 as Edwards or Lester and in 1881 as Neaves.
Proving pretty elusive

Is this her baptism?
Grace Edwards
Baptism 20 Jul 1845 Clifton, St John the Evangelist, Gloucestershire
Father Joseph, labourer Mother Grace
Did her mother Grace remarry a William Parslow?