Check every possible census because occasionally, it will say more than just "Ireland" as place of birth. Also check for Poor Law applications (for financial assistance). If they made any, the records in Scotland will usually give details of the persons parish in Ireland. Finally, if he left a will, you might get a clue from that as it may mention relatives still living in Ireland.
Elwyn