Thanks for digging that up for me altough I am surprised you were able to find the street number. I was recently looking at the 1871 census covering Charles street and didn't see street numbers. I was going to post a followup to my initial request but didn't get around to it... until now.
Are you by any chance taking the schedule number on the census forms to be the street number? I don't believe there is a correlation between the two. Look for a sheet in the same Folio where one street ends and another begins and you'll see what I mean.
My master mariner, James Harries (my Great-Great-Grandfather) stated his address to be 26 Charles Street on his mate and master applications dated 1865, 1867 and 1869. In 1871 he would have been around 26 years old. I know he was married before before 1879 (before marrying my GGGrandmother). So I figured, perhaps if he was married in 1871, a Harries wife alone at 26 Charles Street would be her. But now that I know a little more about the rest of his family, I believe his given address was the household occupied by his brothers and sisters at the time.
From trade directories I was able to put the family at 18 Hamilton Terrace in 1871. In fact, it appears they moved from Charles Street to Hamilton Terrace just prior to the 1871 census.