Thank you everyone! I believe that the Evan and Mary that you have all found is very likely him. Birth years seem to be accurate within a couple of years, and all of the other details match the little bit that we know, including the specific addresses throughout the census records.
I believe around 1904 (when it appears he passed away), his oldest son - also Evan G. Evans (my GG Grandfather) moved south to Mountain Ash, possibly due to the strike at the slate quarry, but now it appears that it may also have happened after his father passed away.
I was able to roughly translate the death notice that was sent along, and now I will work to figure out his burial location (if one can be found). Thank you all so very much for your help!