1854 + Cholera =
http://en.wikipedia.org/wiki/1854_Broad_Street_cholera_outbreak ?
It is possible that he was moved to the Arbour Terrace address when he became ill, either because there was a relative there or for medical treatment. Especially since his wife was still living in Chelsea.
1852 London directory, the following are listed at Arbour Terrace (searched for Arbour Ter on historicaldirectories and then Arbour w/4 Commercial to pick everything up):
Bourne, Wm, upholsterer, 4 Arbour Ter., Commerical rd east
Gable, John, house agent, 12 Arbour Ter., Commerical rd east
Hort, John Kempton, bootmaker, 5 Arbour Ter., Commerical rd east (& 64 Church-lane, Whitechapel)
Keohan, Thomas, optician, 2 Arbour Ter., Commerical rd east
Mann, Richard, shipowner, 18 Arbour Ter., Commerical rd east
Following the 'for medical reasons' line of thought, in 1861 (starting RG9/293 28/18), Arbour Terrace, there is a surgeon at no. 7 (John Erith? Surname is hard to read), and a Gen Practitioner, Robt Howlett, at no. 5.
Also, Jane A. Powell, 24, single and unmarried, b. Shadwell, was living at 3 Arbour Terrace (house servant). A G. F. or C. F. Powell, aged 26, unmarried (woman), b. Stepney, was also living at Hardwick St (nearby) as a servant.