That's what we did this year - we were up real close to the Stone Circle, which was all very peaceful. Only problem was that the path through our field was on a slope, so when it descended into mud and mire, it was doubly-bad on account of being super-slippy!

But no probs whatsoever with noise/crime/drugs/sex out that way :)