Hi Boris,
Although I'm not researching the Atterbys myself I do know that Atterby can often be mistranscribed as Atterly. (Witness Thomas Atterly on the GRO Index in Sep Q 1851. If you don't have the details, I can tell you place and date of the marriage.)
I've also seen double 't' transcribed as double 'l', so is it perhaps worth looking for Benjamin Allerby/Allerly?
Other possiblities:
Alterby, Alterly, Allarby, Attenby, even Allenby.
And in sheer and utter desperation (though highly unlikely I would have thought with a Lincolnshire accent!)any of those with an 'H' in the front.

Pam