deb:
I just wouldn't discount either place ... and, to quote Wikipedia: "The parish church of Northrepps is called St Mary the Virgin and the present church dates from the 15th century but there are records of a church on this site before 1066."
Thorpe Market (from Wikipedia): "The parish church of Thorpe Market is called St Margaret’s. The present church was built in 1796 on the site of an older mediaeval church."
Northrepps is noted as 3.3 miles from Cromer; Thorpe Market is 4.4 miles from Cromer.
Now I guess I need to look in Cromer....
Also, yes, he was an invalid in the 1871 census, but he lived another seven years; might not have lost his faculties.
There may not have been a church at Thorpe Market when he was born; the new one went up in 1796 and there is a big gap in IGI records, per Hugh Wallis.
Maybe he was born in Thorpe Market but, lacking a church, was christened in Northrepps (even though it isn't found) ... OR <big drum roll here> he is the Thomas Joseph baptised in 1796 and they waited until the church was built to do it?

Remember, Charlotte's father is listed as Thomas on her marriage cert ... what if....
P.S. Give Katie a big hug for me; I hope she's feeling much better real soon!