My ancestors were in Marylebone for at least the first half of the nineteenth century and were not wealthy. Servants, porters, and so on. My 5xgreat-grandmother was Elizabeth Ward, born approx 1784, married George Perfett in Marylebone in 1816, died in Marylebone in 1856.
I haven't been able to find any trace of either of them prior to their marriage. Too many Wards to be certain which family is mine. Have worked on a theory that George was from Portsmouth, but haven't been able to prove or disprove conclusively. Any connection with your Wards?