Shame about the marriage, although that was always a bit more of a long shot - worth eliminating though.
The 1881 census does look interesting - and is that birth place actually given as NK North Wales, Rhos? If that's Rhos on Sea (Llandrillo yn Rhos) in Denbighshire, it's pretty much the same place as Ann gave as her place of birth - indeed, Colwyn was once part of the parish of Rhos. Perhaps having been born on the Isle of Man he was brought up in Rhos? I also note from Genuki that there are no extracted entries on the IGI from this parish.