aye up james,
sounds like a combination of things, with the main one being what andy k2 has suggested, gravity.
this will account for the/or most of the vertical error. without knowing calibre, range, and angle, its difficult to assess if 1.5" high is about right.
for the horizontal error, my money would be on canting or wind. when shooting up into trees, or on sloping ground your eyes are easily tricked into thinking you're shooting without canting, so much so that some shots look as though the scope is miles out when you're NOT canting it
not getting your eye behind the scope in exactly the same position as when shooting bench rested would/could account for a marginal amount of error.