Hello Jayson:
I did a lot of research on this family in 2003 and have a large, hard copy family tree, the latest entry on which was born in 1890 (my grandfather, Henry Bayley). Here's what it says about them:
James Bayley of Willaston Hall, Co. Chester, of Stapeley, Co. Chester and of Rumleigh (may not have that right - it's on a fold), Co. Devon, Born 22, May, 1782.
Elizabeth Bayley - only daughter and heir of John Franklin of Rumleigh Co Devon, and Bere Ferrers, Co. Devon. Marr. August 1812.
It does not give the place, but they would have lived in Willaston Hall at that time. There is a nearby church with a collapsed nave with many family tombstones. The records are kept in a nearby church and I would have to sift through boxes to find its name. There is also the larger church in Nantwich where they might have been married. There are plaques with Bayleys on the wall there.
I can tell you about their offspring too, if you like.
I wonder if this James is the one who, in family lore, is immortalized in a print, jumping his horse over a mess table.