There might be a familial link somewhere back in time but my Walter was born 1846 Suffolk, ended up in Norfolk for a while......
This looks like it might be the James and Walter found in 1881...
1861 Census England Norfolk Burnham Ulph and Sutton
RG9/1248/59/17
Burnham Market
BRINKLEY
Johnathan Head Marr 39 Licenced Hawker Hertfordshire Witting
Rachael Wife Marr 39 Wife Herfordshire Walfield
James Son Unmarr 14 Hawker Hertfordshire Southwood
Edward Son Unmarr 12 Norfolk Cley
Walter Son Unmarr 4 Norfolk Flitching
Rosanna Dau Unmarr 1 Norfolk Flitching
Karenlee