Thanks again everyone for your help. Wikipedia in known for its inaccurate information, so he may of not been born in Edinburgh and is the birth date correct. That is why I was hoping to find a church record for him to confirm his parents and date of birth. There also doesn't seem to be a record for his brothers as well. His father died when he was about 7, so this may of had an influence on his life and he may of been in the "House of Refuge for Boys" at that time. But it does seem that he got his life back on track as all the census I can find has his occupation as some form of Teacher/Lecturer.
Lea-Anne