The Four Ashes Inn, 36 Stafford Street is the first household in Enumeration District 9 and here is what the notes say at the beginning of that enumeration district:
"Part of the township of Wolverhampton namely Stafford Street west side from Charles Street to Red Lane, Cannock Road both sides to the boundaries of the township; that is on the North side to the stream, and on the South side from, but not including the "Junction Inn" to the Grand Junction Railway; also Chicken Lane and Carp Street All courts, Alleys and entries included, except entry from Stafford Street to Middle Row (called B??ked Lane"
So I think that Charles Street was a side street off Stafford Street and the Four Ashes stood on the corner. The household at 51 Stafford Street (Brittania Inn) is the last on Stafford Street, next comes Lower Stafford Street.
If you go to
http://www.old-maps.co.uk/and search for co-ordinate 391456,299411
That will get you a map centred on the "dogleg" where Stafford Street and Lower Stafford Street meet. Your pub must have been somewhere south of the dogleg, on the west side of the street, about 8 buildings down. Hope this is a help.