Have a look at the 1861 census again.It records both William and Isaac as born in Sedgley, and Charlotte as born in Dudley.