Nobody needed passports to enter the UK until 1858. People entered and left the country as they pleased. Although Jersey is not part of the UK, because of our close links, access to the island was probably just as easy. Therefore I feel it's highly unlikely that any records were kept.
It was only when an Italian entered France through Britain and tried to assassinate Napoleon III that France insisted Britons must carry passports.
BrianTW