You can't always win, no matter what

Hey fellow readers. From my experience as a blogger, there is a certain situation that has been on my mind for awhile. The reason I got into book blogging was the fact that I loved reading. I also wanted to give my opinions and what I felt about those novels. At first I never imagined anyone would listen, or the fact that I had such a huge audience.
But ever since I started posting my reviews, I always felt put down that not everyone agreed with my thoughts when amazon puts up the number of "helpful votes." I realize not everyone is going to love the same books you love, or that not everyone agrees with what you have to say. But when someone marks that your review was not helpful, it still always manages to hurt just a bit.
As for the title I posted, in this business, I feel that it rings true. It's funny that I gave a very popular book a low rating because I wasn't able to finish it, and a handful of people hinted that my review was not helpful. Then I gave another book a very high rating that had mixed reviews, but ultimately, the unhelpful votes came out on top by one vote.
My main concern on Amazon is that do the "helpful votes" really help people who are thinking about buying the book/item, or is it the content underneath that are used to describe how customers viewed the book/item to persuade you? And on top of that, do you as a reader/customer ever rely or feel persuaded to buy an item on what other bloggers/customers write on Amazon?
And on a related note, do you also think that a rating system helps or hinders overall reviews? Should Amazon get rid of the "helpful votes" and rating system, and just rely on what customers have to say? These are just some of the main points that I wanted to come across today. Feel free to add your feedback on the subject to let me know what you think.