For example, the Census can provide this sort of detail - here's your Frederick in the 1851, he's moved away from Surrey (Windlesham / Bagshot) and also from Susanah's West Drayton PoB to Salisbury ..
1851 - HO107/1847; Folio: 222; Page: 30 - Salisbury
Milford Street
Frederick Rickards 28 Head Postmaster & Corn Merchant born Surrey, Bagshot (part of Windlesham Parish)
Susannah Rickards 27 Wife Middx, Longford
Frederick Rickards 7 son Hants, Yately (just west of Bagshot on the A30)
Benjamin Rickards 5 son Hants, Farnborough
Susannah Rickards 3 dau Wilts, Salisbury
John Rickards 1 son Salisbury
Henry Bunger 28 Servant Driver of Mail Cart
Mary A Bunger 18 Drivers wife
John Godfrey 15 Servant (shop boy)
Fanny Lodge 19 House Servant
from a quick look, it seems that they wont be hard to track thru the census years....