The Joseph Hulbert who married in 1778 does though seem likely to be the one who remarried in Stepney St Dunstan in 1804, the signature is very, very similar, albeit I cannot so far find a burial for his wife Elizabeth. However, from my own experience of researching that period in London, there are quite a lot of missing burial entries (even when checking the original microfilm copies and not relying on online original records). I agree you would have expected them to have had a Joseph and Elizabeth earlier but there is a large gap and there may be a reason for that. One of my own direct ancestors married in Jan 1805, had their first child born in Jan 1806 but then no others until a daughter born in 1815 (so far no baptism found, but other documentary evidence does suggest she is theirs). They then baptised seven children between 1817 and 1827. I did wonder if it was the same couple, but it turns out that the husband, although a silk dyer by profession, joined the navy in 1806 just as his first child was born, and didn't leave until 1815. That was why there was such a gap in children. Two of their later children attended the Greenwich Hospital School which confirmed they were the same couple. So a gap doesn't necessarily mean they cannot be the same couple, they could just have lost a number of children at birth.
In the case of Joseph and Elizabeth Hulbert, to be honest I think its more likely, in light of the 1804 marriage, that the 1778 marriage could well be them, as opposed to the Datchet Joseph Hulbert. I think tassiedevil needs to get a Bucks FHS search done on Hulbert for that period to see if they are in the county and stay there. Its possible although one child was born in London, they could have returned. It did happen to one of my ancestors, three born in London (two in the same Lying-in Hospital) and then the husband got himself convicted of theft and sentenced to 3 years hard labour and a number of month's later the wife and two surviving children were sent back to Devizes because they couldn't look after themselves. They did later return to London.
I am not convinced from what I've seen that Joseph Hulbert (or for that matter Elizabeth Nash if the marriage is correct0 are of Huguenot descent, I really would have expected it to have been mentioned in the two Huguenot Hospital admission records. Added to that is the fact that there do appear to be a lot of Hulberts about and Nash isn't that uncommon a surname either.