What you're currently doing is wrong
Move it side to side, up and down gently.
What!? Dangit. I noticed the stick was a little tilted, I just thought it was funkily assembled. Now I gotta wait till end of workday to mess with it. Actually, I'm not even going straight home after work...GAH!
Fingers crossed that my figure is intact and working.
Thanks for the info everyone. I shall update you all...