For the last fifty years of the 19th century the population of the peninsular communities in Sutherland dropped dramatically, mostly due to emigration. Crofting and fishing were only enough to guarantee a bare subsistence so those who could afford to go would leave. As you say, it's not easy at this distance in time to know why one person migrated and another stayed.