Hi Again,
I've searched the 1861 census for Joseph Junior without success but I think I've found Joseph Senior although his wife seems to be recorded with another name

. This may be an enumerator's mistake.
1861 Census, New Romney, Kent (RG9/555 Folio 61 Page 13)
Joseph HARPER, Head, 49, Collector of Rates under the Poor Law Board, Accountant & General Agent, b. Gloucestershire, Newnham
Phebe HARPER, Wife, 50, b. St Johns Newfoundland, British Subject
I've also found the following in the International Genealogical Index (IGI) at
www.familysearch.orgJoseph HARPER
Birth: 13 AUG 1811
Christening: 09 SEP 1811 Newnham, Gloucester, England
Father: Thos. HARPER
Mother: Mary
Batch No. C030421
Joseph HARPER
Marriage: 11 APR 1839 St Andrews, Clifton, Gloucester, England
Spouse: Sarah Margaret HARRIES
Batch No. M172352
The first record is almost certainly your Joseph Senior although I'm less sure about the second. Clifton is in the West of Bristol and you can just see it's location at the top of the map from the link I gave you.
Hope this is useful.
Regards,
Al