Just for additional background here. Is this what you mean, re the 1851 census?
Hugh Frazer 45 Grocer Draper & Agent (weavers)
Jane Frazer 48...is this Jean Primrose? Marriage 1834
Hugh Frazer 14 lawyer's clerk apprentice
Hugh Cox 12
Mary Weir 18
Address: Dalrymple St, Girvan
And:
Robert Gordon 42 Hand Loom Weaver (cotton), b. Girvan
Jean Gordon 50 washerwoman b. Paisley
Hugh Frazer 16 stepson, Hand Loom Weaver (cotton), b. Girvan
Robert Gordon 11
Peter Morrie 30
Address: Montgomerie St, Girvan
Monica