That's totally true, if you don't touch it there's zero chance it'll get damaged.
In all seriousness, I would argue that folks that modify their figures are probably extra careful. These figures ain't cheap, you're taking a big chance modding your figure in the first place.
I can't speak for others, but I was extremely careful moving my belt boxes, because I read that the belt was delicate, and I still managed to make a tiny tear and a small scuff on mine. I've worked with these kinds of belts many times, and I have a certain level of expectation when it comes to dealing with them. The belt is absolutely more delicate than similar Hot Toys faux leather belts.
I would say that being careful is no guarantee of avoiding damage. Be prepared to have to replace or repair the belt if you futz with it in any way whatsoever.
I'm not terribly worried about my belt, It'll be more durable, have a more secure closure, and be more accurate when I'm done modifying it.
I can honestly say I'm having the most fun modifying this figure than any other I've owned.