Thanks for this.
It suggests that if I want to find baptisms etc, I should try non CofE Registers.
Some of my recent ancestors were Methodists, but I hadn't thought the older ones were. I was a bit confused because these people married at the Cathedral, but it's possible that the bride's family were the "Dissenters".