Hi
Yes it does look like they should be from Hampshire, but finding them is a problem!
Mary's address was 4 Portland Terrace on the wedding certificate .
Yes, Joseph McCormick age 40/42 in 1881 , shipwright/shipwright pensr and widower in 1871 age 32.
In 1851 Joseph (again in Orange St) age 10 with parents.
Can't find him in other censuses.
Fennawright