Aussie Jen,
I don't know if you're still active on this ...but anyway...
This David Lloyd is my wife's gr gr grandfather also. His daughter Annie being the gr gandmother married to Harry Piddington. I've had the same problem as you and by now you may have solved which Mary Boulter he actually married (there were two born in Leominster in the same year but with different parents). The David Lloyd I originally found had Benjamin as the father but with the right date of birth for the marriage. I have an electronic copy of the register (Birmingham Archives) if you want it. I can't resolve the 1861 Census there are three, one in London (a sailor), one in Wales with widowed mother Mary (ag labourer) and one in Wales with father Robert (farm worker). The only marriage I am sure of is the Birmingham one but that was after about 6 or 7 kids had already been born.
Dave