I have a brick wall that I would like to crack - so this is a bit of a longshot as I am aware that Taylor is a surname of travelling people. Any help would be appreciated

Henry Walter Taylor b 1837 (app) in Hastings, Sussex, according to census returns.
In 1870 he marries Elizabeth Lewis in Monmouthshire. The marriage certificate has him aged 30, a bachelor, a labourer and his father as Robert Taylor, labourer, deceased.
1871 census, he is Walter Flay(g)er, a labourer in the ironworks, with wife Elizabeth and (step) daughter Elizabeth in Monmouthshire.
1881 census, he is Walter Taylor and has a daughter LETITIA and a son MESHACK (as well as Walter and Laura & Frederick)- he is a labourer
1891 census he is in Glamorgan and transcribed as Wlater - additional child AGNES
1901 census he is in Glamorgan as Henry W
I would really like to be able to find him with parents or siblings in the early years - any ideas?