I found further information that leads me to believe that Charles Hazen Brown probably stayed in America.
Here is another possibility: BROWN Charles Horatio, son of Horatio G. and Abigail, Feb. 1, 1831 - Reading, Massachusetts
Reading is about 15 miles outside of Boston.