Hi Ellen
You need to wait for Findmypast to publish records for men discharged 1900 to 1913. They are saying 'next month'.
In the meantime was his wife living in a barracks? If so, if you can find the name of a few officers - they are usually at the front of the census return - I can look them up in the army lists of the time and identify his regiment.
Also, where were the children born, and when?
Ken