The only way to be sure would be to find a way of identifying "Front Street" (which doesn't seem to exist any more!) Street names change, or old streets are flattened, so if there is an old Saxilby/Lincoln map existing there might be a chance.
Sad to say, the odds are more likely that the site of Joseph's old inn has been bulldozed.