It seems at that time to be the parish church for the north of bury st Edmunds, known as st James church,only becoming a cathedral in the early 1900s.
According to the national archives records for st James cathedral are at Suffolk archives but their website does not mention any parish records.
Mike
Edit, It seems likely that weddings took place there.