Hi
On the 1851 census it reports he is born in Middlesex, and I assume this means London
The first suggestion is to never assume.
Being born in the county of Middlesex meant just that. In 1851 London consisted of what is now known as the square mile of the City of London. London has spread out since then. By 1889 officially it swallowed up surrounding areas of the counties of Middlesex (which surrounded the city on 3 sides and across the river Thames to its south areas of the county of Surrey and Kent) and became the county of London. In 1965 it swallowed the rest of Middlesex, a larger part of Surrey and parts of the county of Essex and to a far lessere extent Hertfordshire to become Greater London.
This map of the counties of England will allow you to centre down on Middlesex (and the small densley built up area of the City of London in 1851 so you can see Middlesex and all the parishes it comprised of.
http://maps.familysearch.org/P H Reaney 'A Dictionary of Surnames'
Gives the origins of Vickress with Vicarage, Vickerage and Vickridge 'servant of the vicary' giving an early example as Hugh Vicaries 1332.
Where have you found James on the 1851 census?
On the 1841 census adult ages, those over 15, usually had their age rounded down to the nearest 5. The answer yes to born in county on that census can be unreliable.
As you have 'every Vickress recorded on your tree' who was
Burial
31st October 1836 St Leonard Shoreditch
Benjamin Vickress aged 60 Workhouse
as he was living close to James
Regards
Valda
