Sorry, looks like you've pursued the wrong Harry.
FamilySearch pilot has Harry OLIVER, born 1871, son of James, marrying Jessie Louise YEATES aged 23 on 25 Sep 1897 at East Cowes, Whippingham. There is a confirmatory baptism 19 March 1871 at East Cowes for Harry.
Update:
I took a look at your previous thread and, since that was started, it appears there may have been an earlier child:
FreeBMD 4Q 1917 OLIVER Betty R - ref. Southampton 2c 79 - Mother's Maiden name Mackenzie.