what things are happening that made you suspicous. Footprints, trail marks, trash, etc....
Personally I would dig up the plants. But only if I knew for sure someone had been back there. Cause if someone has been back there, then they are either going to call the cops, they are cops, or they are...