Hi, I think you will find that the Baptist Chapel you are interested in is the one that was built in 1827 in the Broadway Bexleyheath. If you go into "Google" click on 2, then at the top of the page is "Ongoing History" if you click on that, first off there are couple of maps, the second one shows the position of the Chapel, then scroll down right to the bottom where there is a photo of the Chapel as it was, and next to it what was built in its place.
I believe it was demolished around 1956.
My paternal grandparents lived for a great deal of their lives in West Street Bexleyheath and are buried in the cemetery there.
Kind Regards,
Kaysy.