My great grandfather Patrick Finn migrated to Australia (forcibly) in 1836.
His parents and younger brother came the same way the next year, all charged with the same crime on the same day. Some wag suggested it was their way of getting a cheap passage here - they were apparently model prisoners because there was little documentation on them after landing, indeed we still haven't found Jane the mother, since.
Patrick, after he did his time, was cleared to leave the country and went back. But a few years later we find him charged with some minor misdemeanour and sent out again. He went to VDL for his troubles this time but did his time and moved to New South Wales where he met and married Mary Fisher, an Irish orphan sent on the "Lady Peel" and they raised a large family (between a few more jail stints for Patrick, mostly for brawling!).
So even in the early 1800s there was apparently quite a bit of cross migration. People got homesick for their native land even when it had treated them harshly, just as people get homesick today. What often brings them back is the better weather out here

Dawn M