Anyone still watching this thread? I've had some success with the shorthand. It's a variant of system called `Mason', which went through countless editions, variations and so-called improvements both under Mason's name and perhaps more famously (if you're into such things!) under Gurney's name. The variant we are looking at seems to be a lightly customised version of what's known as `Gurney's Mason', or `Brachygraphy'. Late 18th to early 19th century.
I have begun a transcription. Yes, it's verse, and rather disappointingly seems to be devotional rather than romantic

Snippet from page 1 column 2: "Eternal truth attends the word"
Although more intriguing is the beginning of the very last stanza (under the numeral 5): "Away <?> falls delusive toys"
Sean.