Hi there Laura
Could this be him in the 1891 census
RG12/ 819/ Folio 41/ Page 15 - Hove
William Potter, 35, born Sumpton?, Sussex, Head - General Labourer
Elizabeth Potter, 27, born Chedworth, Gloucestershire, Wife
Ethel B E Potter, 4, born Hove, Sussex, Daughter
Walter S Potter, 1, born Hove, Sussex, Son.
Chris in 1066