Hi Pibrocher.
I have the same problem as you. My 2xG.Grandfather (my brickwall) was a solder at the Woolwich Barracks.
We believe he may have been married before he married my 2xG.Grandmother.
The first marriage was in 1835 at St Luke, Old Charlton Kent. The two daughters from this marriage were Baptized at St Mary Magdalene Woolwich. The wife and two girls died in 1840 + 1841, and were buried at St Mary Magdalene Woolwich.
Then by 1844, he has re-married and has a daughter, another daughter is born in 1845 at the same time the first daughter dies. Both girls were baptized at St Mary Magdalene Woolwich, the first buried at Woolwich. I cannot found any marriage for them at all, the only possible one in 1843 has the wrong name for the bride which was in Lewisham.
After 1845 they disappear from all the census etc. until my Great grandmother marries in 1865 in Liverpool. We
may have found his death which was in Ireland Portobello, in 1854(We don't believe he was Irish), stated as a Sergeant in the Royal Horse Artillery.
I have been to this site......
http://www.nwkfhs.org.uk/char_plc.htmCharlton, St Luke
Ancient Parish church.
Original Registers
These date from 1653.
Don't know if this site will help you but it's worth a look.
I did contact the Woolwich Barracks to see what records they hold and was informed that all the records are held at the London Metropolitan Archives.