How do you stop pole wobbling in dry stone wall?

I've built a dry stone wall (a pretty poor one) around a pole, the pole keeps wobbling though! how could I prevent this? The walls maybe 4.5 foot tall, and the poles maybe about 7.5 foot tall?