Welcome to Rootschat!!
Have you found him on a census at all?
If you want help, you will need to give more details eg his full name, dates even if they are approximate.
My 2x gt grandfather's sister was a housemaid there and can be found on the 1871 census.
I wanted to know if she was still there when Winston Chirchill was born, as she had left by 1881.
The archivist said that the housekeeper didn't actually keep names of her employees - she only paid them and on investigation could find no further record of her.
It might be the same with the gardeners. The head gardener might pay his workers, but might not actually record them. So unless your ? King was really Head Gardener, there may not be a record.