I can't find any surviving records for particular baptists in Diss, there are some for Wymondham from 1827 onwards, but those are the closest ones.
Of course, at that date, even if they were particualar baptists, they would have had to marry in a parish church , to make the marriage legal.