To marry over the broomstick was to go through a quasi-marriage ceremony in which the parties jumped over the broomstick.
To marry over the broomstick is an old term meaning that a couple were joined in a common-law union by jumping over a broomstick together.
In English Law, since 1753, there is no such thing as a 'common law marriage', in the eyes of the law there is no special relationship and they are not equivalent to a husband or wife.
Stan