I'm pretty sure it will change!
Neelix really did grow on me during the seasons. There are moments that are quite touching. He's a good guy.
I was worried I might not be able (as a woman) to look past Sevens tight suit but she is such a wonderful character and I ended up liking her very much.
I did not like Tom in the beginning either when he was portrayed as the womanizer and funny guy but again he has huge character growth. Are you listening to the Deltaflyers podcast with Robbie and Garrett while watching?
They are watching the episodes and then talk about them. You can see what good friends they are, it's often very funny but also very interesting and my appreciation of Tom has grown immensely since I know Robbie better.
Many say that Chakotay is boring but I don't see it myself. He does what a good first officer does - deal with all the trouble in quiet and keep the captain's back free. He supports her in every way he can which does not mean they're not butting heads once in a while when they have different opinions.
So basically - keep watching