I know your main purpose is to find James Patton's ancestry and all of the above may seem irrelevant.
However - we need to establish exactly who, when and where he married to enable you to buy a copy cert to get his fathers name/occupation
None of the available census info gives his exact birthplace within Scotland and the 1841 has quite a number of possibilities