I've been on a balloon ride once. Flying along is easy. The scariest part was when they untie the thing. They had us sit on the basket with one leg in and one leg out (don't ask me why they didn't want us all the way in). They untie it, and the pilot (all the way in, BTW) shouts, 'jump in!.' Well, the basket is high enough that your foot on the inside isn't touching the floor. You have to lift yourself up on your arms and reach for the floor while balancing on a 2" wicker basket. Oh yeah, like Prog says, the balloon is going up like a rocket. You're trying to get in, and you look at the ground disappearing and it was little freaky.
Flying is pretty relaxing. The balloon travels at the same speed as the wind so it is very quiet and calm. The top of the basket is higher than your waist so you don't feel like you might fall out.