Any tree on Ancestry should be treated as unreliable, particularly when, as in this case, no baptism is shown and the birth is "about 1806" at Warboys. In other words it's pure guesswork as to who his parents were in the absence of his baptism. Yes, the chances are that he was the son of Henry and Mary. But which Mary is the whole point here. There are two marriages of a Henry Amps to a Mary at about the right time in about the right place. The tree shows Mary Amps' birthplace as Godmanchester yet the 1851 census shows it as Warboys, pointing to her possibly being the Mary Smith who married Henry Amps in Warboys in 1803, rather than Mary Gadsby who married Henry Amps in Godmanchester in 1798.
There is only one Amps baptism in Godmanchester - Mary dau of Henry and Mary on 6 Dec 1801. Did this family then move to Warboys, 8 miles away, where one or other of the Marys may have died and was buried in 1802? If it was the mother did Henry remarry the following year?
As I said before when you suggested the Godmanchester marriage, it needs reference to Warboys and Godmanchester parish registers to try to separate the two Marys. And Ancestry trees won't provide the answer
David