I note that Elsie Rufey's father died in 1960 at Hare Hatch, Berkshire, her husband Gregory Le Heinsworth died in 1954, so with young children she probably decided to return to England.
Now to find any shipping records of her return, but then maybe she flew back, as both daughters were living back in Berkshire at a later date.
Jan