Where was the birth registered?
I wonder why you say 'obviously illegitimate'?
I think that the fact that she calls herself Price formerly Jones means that she is married and although it is a coincidence, the 1850 marriage is not the right one since we know from the record that the Price and Jones on that page did not marry each other. Price and Jones are common enough names.
Bev